Sep 16 17:30:14 devstack cinder-volume[74877]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 16 17:30:14 devstack cinder-volume[74877]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 16 17:30:14 devstack cinder-volume[74877]: we strongly recommend against using it for new projects. Sep 16 17:30:14 devstack cinder-volume[74877]: If you are already using Eventlet, we recommend migrating to a different Sep 16 17:30:14 devstack cinder-volume[74877]: framework. For more detail see Sep 16 17:30:14 devstack cinder-volume[74877]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 16 17:30:14 devstack cinder-volume[74877]: import eventlet # noqa Sep 16 17:30:17 devstack cinder-volume[74877]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74877) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 16 17:30:17 devstack cinder-volume[74877]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74877) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 16 17:30:17 devstack cinder-volume[74877]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74877) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 16 17:30:18 devstack cinder-volume[74877]: INFO dbcounter [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Registered counter for database cinder Sep 16 17:30:18 devstack cinder-volume[74877]: DEBUG oslo_db.sqlalchemy.engines [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74877) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 17:30:18 devstack cinder-volume[74877]: DEBUG dbcounter [-] [74877] Writer thread running {{(pid=74877) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 16 17:30:18 devstack cinder-volume[74877]: INFO cinder.rpc [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 16 17:30:18 devstack cinder-volume[74877]: INFO cinder.rpc [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 16 17:30:18 devstack cinder-volume[74877]: DEBUG oslo_db.sqlalchemy.engines [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74877) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 17:30:18 devstack cinder-volume[74877]: INFO cinder.volume.manager [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Determined volume DB was empty at startup. Sep 16 17:30:18 devstack cinder-volume[74877]: DEBUG cinder.volume.manager [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74877) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 16 17:30:18 devstack cinder-volume[74877]: INFO cinder.volume.manager [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 16 17:30:18 devstack cinder-volume[74877]: WARNING stevedore.named [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 17:30:18 devstack cinder-volume[74877]: WARNING castellan.key_manager [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 17:30:18 devstack cinder-volume[74877]: WARNING cinder.keymgr.conf_key_mgr [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 17:30:18 devstack cinder-volume[74877]: DEBUG cinder.volume.drivers.lvm [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74877) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 16 17:30:18 devstack cinder-volume[74877]: DEBUG oslo_concurrency.processutils [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:18 devstack cinder-volume[74877]: DEBUG oslo_concurrency.processutils [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] CMD "cinder-rtstool verify" returned: 0 in 0.388s {{(pid=74877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_db.sqlalchemy.engines [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74877) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 17:30:19 devstack cinder-volume[74877]: INFO cinder.rpc [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 16 17:30:19 devstack cinder-volume[74877]: INFO cinder.rpc [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 16 17:30:19 devstack cinder-volume[74877]: WARNING stevedore.named [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 17:30:19 devstack cinder-volume[74877]: WARNING castellan.key_manager [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 17:30:19 devstack cinder-volume[74877]: INFO cinder.volume.manager [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_db.sqlalchemy.engines [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74877) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 17:30:19 devstack cinder-volume[74877]: INFO oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Starting 1 workers Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Started child 75037 {{(pid=74877) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Full set of CONF: {{(pid=74877) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] ******************************************************************************** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Configuration options gathered from: {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] ================================================================================ {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] allow_availability_zone_fallback = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] allow_compression_on_image_upload = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] allowed_direct_url_schemes = [] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] api_rate_limit = True {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] auth_strategy = keystone {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] az_cache_duration = 3600 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_availability_zone = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[75037]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_host = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_name = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_stats_polling_interval = 60 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backup_api_class = cinder.backup.api.API {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backup_name_template = backup-%s {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backup_use_same_host = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backup_use_temp_snapshot = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] chap_password = **** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] chap_username = {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cinder_internal_tenant_project_id = 04e27bfa226f4efbb561447660fd53be {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cinder_internal_tenant_user_id = 4a094ff0475b4683ad5d04a1156cffbe {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cloned_volume_same_az = True {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cluster = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] compression_format = gzip {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] compute_api_class = cinder.compute.nova.API {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] config_dir = [] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] config_source = [] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] control_exchange = openstack {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] debug = True {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] default_availability_zone = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] default_group_type = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] default_volume_type = lvmdriver-1 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] disk_geometry = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] driver_client_cert = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] driver_client_cert_key = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] driver_data_namespace = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] driver_ssl_cert_path = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] driver_ssl_cert_verify = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] driver_use_ssl = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] enable_force_upload = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] enable_new_services = True {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] enable_unsupported_driver = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] enabled_backends = ['lvmdriver-1'] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] enforce_multipath_for_image_xfer = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] filter_function = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] glance_api_insecure = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] glance_api_servers = ['http://192.168.122.235/image'] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] glance_api_ssl_compression = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] glance_ca_certificates_file = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] glance_catalog_info = image:glance:publicURL {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] glance_certfile = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] glance_keyfile = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] glance_num_retries = 3 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] glance_request_timeout = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] goodness_function = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] graceful_shutdown_timeout = 5 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] group_api_class = cinder.group.api.API {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] host = devstack {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] image_compress_on_upload = True {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] image_conversion_address_space_limit = 1 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] image_conversion_cpu_limit = 60 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] image_conversion_disable = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] image_upload_use_cinder_backend = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] image_upload_use_internal_tenant = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] image_volume_cache_enabled = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] image_volume_cache_max_count = 0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] image_volume_cache_max_size_gb = 0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] init_host_max_objects_retrieval = 0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] instance_format = [instance: %(uuid)s] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] iscsi_target_flags = {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] iscsi_write_cache = on {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] iser_helper = tgtadm {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] iser_ip_address = 192.168.122.235 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] iser_port = 3260 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] log_color = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] log_config_append = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] log_dir = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] log_file = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] log_options = True {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] log_rotate_interval = 1 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] log_rotate_interval_type = days {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] log_rotation_type = none {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] max_age = 0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] max_logfile_count = 30 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] max_logfile_size_mb = 200 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] max_over_subscription_ratio = 20.0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] message_reap_interval = 86400 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] message_ttl = 2592000 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] migration_create_volume_timeout_secs = 300 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] monkey_patch = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] monkey_patch_modules = [] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] my_ip = 192.168.122.235 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] no_snapshot_gb_quota = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] num_iser_scan_tries = 3 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] num_shell_tries = 3 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] num_volume_device_scan_tries = 3 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] nvmeof_conn_info_version = 1 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] nvmet_ns_id = 10 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] nvmet_port_id = 1 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] osapi_max_limit = 1000 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] osapi_volume_ext_list = [] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] osapi_volume_listen_port = 8776 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] osapi_volume_use_ssl = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] osapi_volume_workers = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] per_volume_size_limit = -1 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] periodic_fuzzy_delay = 60 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] periodic_interval = 60 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] public_endpoint = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] publish_errors = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] quota_backup_gigabytes = 1000 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] quota_backups = 10 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] quota_gigabytes = 1000 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] quota_groups = 10 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] quota_snapshots = 10 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] quota_volumes = 10 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] rate_limit_burst = 0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] rate_limit_except_level = CRITICAL {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] rate_limit_interval = 0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] reinit_driver_count = 3 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] replication_device = **** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] report_discard_supported = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[75037]: INFO cinder.volume.manager [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] report_interval = 120 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] reservation_clean_interval = 86400 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] reservation_expire = 86400 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] reserved_image_namespaces = [] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] reserved_percentage = 0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] rpc_response_timeout = 120 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] run_external_periodic_tasks = True {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] scst_target_driver = iscsi {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] scst_target_iqn_name = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] service_down_time = 720 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] shell_completion = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] snapshot_name_template = snapshot-%s {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] snapshot_same_host = True {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] split_loggers = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] state_path = /opt/stack/data/cinder {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] storage_availability_zone = nova {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] storage_protocol = iSCSI {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] syslog_log_facility = LOG_USER {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] target_helper = lioadm {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] target_ip_address = 192.168.122.235 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] target_port = 3260 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] target_protocol = iscsi {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] target_secondary_ip_addresses = [] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] trace_flags = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] transport_url = **** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] until_refresh = 0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] use_chap_auth = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] use_default_quota_class = True {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] use_journal = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] use_json = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] use_multipath_for_image_xfer = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] use_stderr = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] use_syslog = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] verify_glance_signatures = enabled {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] volume_api_class = cinder.volume.api.API {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] volume_backend_name = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] volume_clear = zero {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] volume_clear_ionice = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] volume_clear_size = 0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] volume_copy_bps_limit = 0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] volume_dd_blocksize = 1M {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] volume_name_template = volume-%s {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] volume_service_inithost_offload = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] volume_usage_audit_period = month {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] zoning_mode = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:30:19 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_concurrency.disable_process_locking = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.auth_section = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.auth_type = password {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.auth_version = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.cache = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.certfile = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.include_service_catalog = True {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.insecure = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.interface = public {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.keyfile = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.memcache_password = **** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.memcache_username = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.region_name = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.service_type = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.235/identity {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.backend = dogpile.cache.null {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.backend_argument = **** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.backend_expiration_time = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.config_prefix = cache.oslo {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.debug_cache_backend = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.enable_retry_client = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.enable_socket_keepalive = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.enabled = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.expiration_time = 600 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.hashclient_retry_attempts = 2 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.memcache_dead_retry = 300 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.memcache_pool_maxsize = 10 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.memcache_sasl_enabled = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.password = **** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.proxies = [] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.redis_db = 0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.redis_server = localhost:6379 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.retry_attempts = 2 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.retry_delay = 0.0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.socket_keepalive_count = 1 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.socket_keepalive_idle = 1 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.socket_keepalive_interval = 1 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.socket_timeout = 1.0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.tls_allowed_ciphers = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.tls_cafile = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.tls_certfile = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.tls_enabled = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.tls_keyfile = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cache.username = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] coordination.backend_url = **** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] database.asyncio_connection = **** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] database.asyncio_slave_connection = **** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] database.backend = sqlalchemy {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] database.connection = **** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] database.connection_debug = 0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] database.connection_parameters = {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] database.connection_recycle_time = 3600 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] database.connection_trace = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] database.db_inc_retry_interval = True {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] database.db_max_retries = 20 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] database.db_max_retry_interval = 10 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] database.db_retry_interval = 1 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] database.max_overflow = 50 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] database.max_pool_size = 5 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] database.max_retries = 10 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] database.mysql_wsrep_sync_wait = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] database.pool_timeout = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] database.retry_interval = 10 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] database.slave_connection = **** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] database.sqlite_synchronous = True {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] database.synchronous_reader = True {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] database.use_db_reconnect = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_tracing.insecure = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] profiler.connection_string = messaging:// {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] profiler.enabled = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] profiler.es_doc_type = notification {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] profiler.es_scroll_size = 10000 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] profiler.es_scroll_time = 2m {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] profiler.filter_error_trace = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] profiler.hmac_keys = **** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] profiler.sentinel_service_name = mymaster {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] profiler.socket_timeout = 0.1 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] profiler.trace_requests = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] profiler.trace_sqlalchemy = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] profiler_jaeger.process_tags = {} {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] profiler_jaeger.service_name_prefix = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] profiler_otlp.service_name_prefix = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_policy.enforce_new_defaults = True {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_policy.policy_default_rule = default {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_policy.policy_file = policy.yaml {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] privsep_osbrick.group = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] privsep_osbrick.helper_command = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] privsep_osbrick.user = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cinder_sys_admin.group = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cinder_sys_admin.helper_command = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] cinder_sys_admin.user = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] service_user.auth_section = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] service_user.auth_type = password {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] service_user.cafile = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] service_user.certfile = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] service_user.collect_timing = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] service_user.insecure = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] service_user.keyfile = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] service_user.send_service_user_token = True {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] service_user.split_loggers = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] service_user.timeout = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] service_user.tls_ciphers = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] service_user.tls_min_version = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack sudo[75041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] glance.auth_section = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] glance.auth_type = password {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] glance.certfile = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] glance.collect_timing = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] glance.insecure = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] glance.keyfile = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack sudo[75041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] glance.region_name = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] glance.split_loggers = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] glance.timeout = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] glance.tls_ciphers = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] glance.tls_min_version = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.backend_availability_zone = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.chap_password = **** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.chap_username = {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.disk_geometry = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.driver_client_cert = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.driver_client_cert_key = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.driver_data_namespace = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.driver_use_ssl = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.extra_capabilities = {} {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.filter_function = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.goodness_function = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.iscsi_target_flags = {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.iscsi_write_cache = on {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.iser_helper = tgtadm {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.iser_ip_address = 192.168.122.235 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.iser_port = 3260 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.lvm_mirrors = 0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.lvm_share_target = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.lvm_type = auto {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.num_shell_tries = 3 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.replication_device = **** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.report_discard_supported = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.reserved_percentage = 0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.target_helper = tgtadm {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.target_ip_address = 192.168.122.235 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.target_port = 3260 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.target_protocol = iscsi {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.trace_flags = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.unique_fqdn_network = True {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.use_chap_auth = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.volume_backend_name = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.volume_clear = zero {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.volume_clear_ionice = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.volume_clear_size = 0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.volume_group = cinder-volumes {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_reports.file_event_handler = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_reports.log_dir = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.backend_availability_zone = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.backend_host = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.chap_password = **** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.chap_username = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.chiscsi_conf = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.disk_geometry = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.driver_client_cert = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.driver_data_namespace = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.driver_use_ssl = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.extra_capabilities = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.filter_function = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.goodness_function = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.iser_helper = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.iser_ip_address = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.iser_port = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.iser_target_prefix = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.lvm_conf_file = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.lvm_mirrors = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.lvm_share_target = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.lvm_type = auto {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.num_shell_tries = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.nvmet_port_id = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.replication_device = **** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.report_discard_supported = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.reserved_percentage = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.scst_target_driver = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.storage_protocol = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.target_helper = lioadm {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.target_ip_address = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.target_port = 3260 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.target_protocol = iscsi {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.trace_flags = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.use_chap_auth = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.volume_clear = zero {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.volume_clear_size = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] lvmdriver-1.volumes_dir = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.ssl = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_notifications.driver = [] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_notifications.retry = -1 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] key_manager.fixed_key = **** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican.barbican_api_version = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican.barbican_endpoint = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican.barbican_endpoint_type = public {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican.barbican_region_name = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican.cafile = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican.certfile = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican.collect_timing = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican.insecure = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican.keyfile = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican.number_of_retries = 60 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican.retry_delay = 1 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican.send_service_user_token = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican.split_loggers = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican.timeout = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican.tls_ciphers = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican.tls_min_version = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican.verify_ssl = True {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican.verify_ssl_path = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican_service_user.auth_section = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican_service_user.auth_type = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican_service_user.cafile = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican_service_user.certfile = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican_service_user.collect_timing = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican_service_user.insecure = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican_service_user.keyfile = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican_service_user.split_loggers = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican_service_user.timeout = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican_service_user.tls_ciphers = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] barbican_service_user.tls_min_version = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] vault.approle_role_id = **** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] vault.approle_secret_id = **** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] vault.auth_method = approle {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] vault.auth_path = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] vault.kv_mountpoint = secret {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] vault.kv_path = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] vault.kv_version = 2 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] vault.namespace = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] vault.root_token_id = **** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] vault.ssl_ca_crt_file = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] vault.timeout = 60.0 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] vault.token_file = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] vault.token_role = None {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] vault.use_ssl = False {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:30:19 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] ******************************************************************************** {{(pid=74877) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 16 17:30:19 devstack sudo[75041]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:19 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.337s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:19 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:19 devstack sudo[75099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 17:30:19 devstack sudo[75099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:19 devstack sudo[75099]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:19 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.290s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:19 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:30:19 devstack cinder-volume[75037]: INFO cinder.brick.local_dev.lvm [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 16 17:30:19 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:20 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:20 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:20 devstack sudo[75245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 17:30:20 devstack sudo[75245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:20 devstack sudo[75245]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:20 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.332s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:20 devstack cinder-volume[75037]: DEBUG cinder.brick.local_dev.lvm [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75037) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 16 17:30:20 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:20 devstack sudo[75352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 17:30:20 devstack sudo[75352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:20 devstack sudo[75352]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:20 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.526s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:20 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:20 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:20 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:20 devstack sudo[75560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 17:30:20 devstack sudo[75560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:21 devstack sudo[75560]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:21 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:21 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:21 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:21 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:21 devstack sudo[75653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 16 17:30:21 devstack sudo[75653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:21 devstack sudo[75653]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:21 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.256s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:21 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:21 devstack sudo[75656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 17:30:21 devstack sudo[75656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:21 devstack sudo[75656]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:21 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.365s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:21 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:21 devstack sudo[75739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 17:30:21 devstack sudo[75739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:22 devstack sudo[75739]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:22 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:22 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:22 devstack sudo[75746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 17:30:22 devstack sudo[75746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:22 devstack sudo[75746]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:22 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.334s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:22 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:22 devstack sudo[75831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 17:30:22 devstack sudo[75831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:22 devstack sudo[75831]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:22 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:22 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:22 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:22 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:22 devstack sudo[75835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 17:30:22 devstack sudo[75835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:23 devstack sudo[75835]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:23 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:23 devstack cinder-volume[75037]: INFO cinder.volume.drivers.lvm [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 16 17:30:23 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:23 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:23 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:23 devstack sudo[75839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 17:30:23 devstack sudo[75839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:23 devstack sudo[75839]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:23 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:23 devstack cinder-volume[75037]: DEBUG cinder.volume.drivers.lvm [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Updating volume stats {{(pid=75037) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 16 17:30:23 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:23 devstack sudo[75842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 17:30:23 devstack sudo[75842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:23 devstack sudo[75842]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:23 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:23 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:23 devstack sudo[75845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 17:30:23 devstack sudo[75845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:23 devstack sudo[75845]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:23 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:23 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:23 devstack sudo[75854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 17:30:23 devstack sudo[75854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:24 devstack sudo[75854]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:24 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.240s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:24 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:24 devstack sudo[75857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 17:30:24 devstack sudo[75857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:24 devstack sudo[75857]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:24 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:24 devstack cinder-volume[75037]: INFO cinder.volume.driver [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Driver hasn't implemented _init_vendor_properties() Sep 16 17:30:24 devstack cinder-volume[75037]: DEBUG cinder.volume.driver [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75037) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 16 17:30:24 devstack cinder-volume[75037]: DEBUG oslo_db.sqlalchemy.engines [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75037) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 17:30:24 devstack cinder-volume[75037]: DEBUG dbcounter [-] [75037] Writer thread running {{(pid=75037) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 16 17:30:24 devstack cinder-volume[75037]: DEBUG cinder.db.api [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Building query based on filter {{(pid=75037) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 16 17:30:24 devstack cinder-volume[75037]: DEBUG cinder.image.image_utils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75037) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 16 17:30:24 devstack cinder-volume[75037]: INFO cinder.keymgr.migration [None req-618fd227-b14f-4b69-aca9-f48f3300ab7a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 16 17:30:24 devstack cinder-volume[75037]: DEBUG cinder.volume.drivers.lvm [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Updating volume stats {{(pid=75037) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 16 17:30:24 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:24 devstack sudo[75860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 17:30:24 devstack sudo[75860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:24 devstack sudo[75860]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:24 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:24 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:24 devstack sudo[75865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 17:30:24 devstack sudo[75865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:24 devstack sudo[75865]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:24 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:24 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:24 devstack sudo[75868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 17:30:24 devstack sudo[75868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:25 devstack sudo[75868]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:25 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:25 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:25 devstack sudo[75871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 17:30:25 devstack sudo[75871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:25 devstack sudo[75871]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:25 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:25 devstack cinder-volume[75037]: DEBUG cinder.manager [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Notifying Schedulers of capabilities ... {{(pid=75037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:30:25 devstack cinder-volume[75037]: INFO cinder.volume.manager [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Driver initialization completed successfully. Sep 16 17:30:25 devstack cinder-volume[75037]: INFO cinder.manager [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Initiating service 2 cleanup Sep 16 17:30:25 devstack cinder-volume[75037]: INFO cinder.manager [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Service 2 cleanup completed. Sep 16 17:30:25 devstack cinder-volume[75037]: DEBUG cinder.service [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Creating RPC server for service cinder-volume {{(pid=75037) start /opt/stack/cinder/cinder/service.py:231}} Sep 16 17:30:25 devstack cinder-volume[75037]: DEBUG cinder.service [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75037) start /opt/stack/cinder/cinder/service.py:237}} Sep 16 17:30:25 devstack cinder-volume[75037]: INFO cinder.volume.manager [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 16 17:30:25 devstack cinder-volume[75037]: DEBUG cinder.volume.drivers.lvm [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Updating volume stats {{(pid=75037) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 16 17:30:25 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:25 devstack sudo[75875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 17:30:25 devstack sudo[75875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:25 devstack sudo[75875]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:25 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:25 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:25 devstack sudo[75878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 17:30:25 devstack sudo[75878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:26 devstack sudo[75878]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:26 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:26 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:26 devstack sudo[75883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 17:30:26 devstack sudo[75883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:26 devstack sudo[75883]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:26 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:26 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:30:26 devstack sudo[75900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 17:30:26 devstack sudo[75900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:30:26 devstack sudo[75900]: pam_unix(sudo:session): session closed for user root Sep 16 17:30:26 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.369s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:30:26 devstack cinder-volume[75037]: INFO cinder.volume.manager [None req-95f57cd9-4a2d-4c33-b690-b0347dc1ec96 None None] Driver post RPC initialization completed successfully. Sep 16 17:30:29 devstack cinder-volume[74877]: DEBUG dbcounter [-] [74877] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74877) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:30:36 devstack cinder-volume[75037]: DEBUG dbcounter [-] [75037] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75037) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:30:36 devstack cinder-volume[75037]: DEBUG dbcounter [-] [75037] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75037) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:31:26 devstack cinder-volume[75037]: DEBUG oslo_service.periodic_task [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75037) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:31:26 devstack cinder-volume[75037]: DEBUG cinder.volume.drivers.lvm [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Updating volume stats {{(pid=75037) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 16 17:31:26 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:31:26 devstack sudo[77898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 17:31:26 devstack sudo[77898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:31:27 devstack sudo[77898]: pam_unix(sudo:session): session closed for user root Sep 16 17:31:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:31:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:31:27 devstack sudo[77935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 17:31:27 devstack sudo[77935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:31:27 devstack sudo[77935]: pam_unix(sudo:session): session closed for user root Sep 16 17:31:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:31:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:31:27 devstack sudo[77940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 17:31:27 devstack sudo[77940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:31:27 devstack sudo[77940]: pam_unix(sudo:session): session closed for user root Sep 16 17:31:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.237s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:31:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:31:27 devstack sudo[77943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 17:31:27 devstack sudo[77943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:31:27 devstack sudo[77943]: pam_unix(sudo:session): session closed for user root Sep 16 17:31:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:31:27 devstack cinder-volume[75037]: DEBUG cinder.manager [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Notifying Schedulers of capabilities ... {{(pid=75037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:31:27 devstack cinder-volume[75037]: DEBUG oslo_service.periodic_task [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Running periodic task VolumeManager._thread_info {{(pid=75037) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:31:27 devstack cinder-volume[75037]: DEBUG cinder.volume.manager [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] thread count: 6 {{(pid=75037) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:31:27 devstack cinder-volume[75037]: DEBUG cinder.volume.manager [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] thread info: [<_MainThread(MainThread, started 127944132300928)>, , , , , ] {{(pid=75037) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:32:26 devstack cinder-volume[75037]: DEBUG oslo_service.periodic_task [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75037) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:32:26 devstack cinder-volume[75037]: DEBUG cinder.volume.drivers.lvm [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Updating volume stats {{(pid=75037) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 16 17:32:26 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:32:26 devstack sudo[81211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 17:32:26 devstack sudo[81211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:32:27 devstack sudo[81211]: pam_unix(sudo:session): session closed for user root Sep 16 17:32:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:32:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:32:27 devstack sudo[81214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 17:32:27 devstack sudo[81214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:32:27 devstack sudo[81214]: pam_unix(sudo:session): session closed for user root Sep 16 17:32:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:32:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:32:27 devstack sudo[81270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 17:32:27 devstack sudo[81270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:32:27 devstack sudo[81270]: pam_unix(sudo:session): session closed for user root Sep 16 17:32:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:32:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:32:27 devstack sudo[81297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 17:32:27 devstack sudo[81297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:32:27 devstack sudo[81297]: pam_unix(sudo:session): session closed for user root Sep 16 17:32:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:32:27 devstack cinder-volume[75037]: DEBUG cinder.manager [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Notifying Schedulers of capabilities ... {{(pid=75037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:32:27 devstack cinder-volume[75037]: DEBUG oslo_service.periodic_task [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Running periodic task VolumeManager._thread_info {{(pid=75037) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:32:27 devstack cinder-volume[75037]: DEBUG cinder.volume.manager [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] thread count: 6 {{(pid=75037) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:32:27 devstack cinder-volume[75037]: DEBUG cinder.volume.manager [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] thread info: [<_MainThread(MainThread, started 127944132300928)>, , , , , ] {{(pid=75037) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:32:36 devstack cinder-volume[75037]: DEBUG dbcounter [-] [75037] Writing DB stats cinder:SELECT=1 {{(pid=75037) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:32:36 devstack cinder-volume[75037]: DEBUG dbcounter [-] [75037] Writing DB stats cinder:UPDATE=1 {{(pid=75037) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:33:26 devstack cinder-volume[75037]: DEBUG oslo_service.periodic_task [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75037) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:33:26 devstack cinder-volume[75037]: DEBUG cinder.volume.drivers.lvm [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Updating volume stats {{(pid=75037) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 16 17:33:26 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:33:26 devstack sudo[83262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 17:33:26 devstack sudo[83262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:33:27 devstack sudo[83262]: pam_unix(sudo:session): session closed for user root Sep 16 17:33:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:33:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:33:27 devstack sudo[83278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 17:33:27 devstack sudo[83278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:33:27 devstack sudo[83278]: pam_unix(sudo:session): session closed for user root Sep 16 17:33:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:33:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:33:27 devstack sudo[83287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 17:33:27 devstack sudo[83287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:33:27 devstack sudo[83287]: pam_unix(sudo:session): session closed for user root Sep 16 17:33:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:33:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:33:27 devstack sudo[83294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 17:33:27 devstack sudo[83294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:33:27 devstack sudo[83294]: pam_unix(sudo:session): session closed for user root Sep 16 17:33:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:33:27 devstack cinder-volume[75037]: DEBUG cinder.manager [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Notifying Schedulers of capabilities ... {{(pid=75037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:34:26 devstack cinder-volume[75037]: DEBUG oslo_service.periodic_task [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75037) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:34:26 devstack cinder-volume[75037]: DEBUG cinder.volume.drivers.lvm [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Updating volume stats {{(pid=75037) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 16 17:34:26 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:34:26 devstack sudo[84493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 17:34:26 devstack sudo[84493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:34:27 devstack sudo[84493]: pam_unix(sudo:session): session closed for user root Sep 16 17:34:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:34:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:34:27 devstack sudo[84497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 17:34:27 devstack sudo[84497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:34:27 devstack sudo[84497]: pam_unix(sudo:session): session closed for user root Sep 16 17:34:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:34:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:34:27 devstack sudo[84500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 17:34:27 devstack sudo[84500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:34:27 devstack sudo[84500]: pam_unix(sudo:session): session closed for user root Sep 16 17:34:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:34:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:34:27 devstack sudo[84514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 17:34:27 devstack sudo[84514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:34:27 devstack sudo[84514]: pam_unix(sudo:session): session closed for user root Sep 16 17:34:27 devstack cinder-volume[75037]: DEBUG oslo_concurrency.processutils [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:34:27 devstack cinder-volume[75037]: DEBUG cinder.manager [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Notifying Schedulers of capabilities ... {{(pid=75037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:34:27 devstack cinder-volume[75037]: DEBUG oslo_service.periodic_task [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] Running periodic task VolumeManager._thread_info {{(pid=75037) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:34:27 devstack cinder-volume[75037]: DEBUG cinder.volume.manager [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] thread count: 6 {{(pid=75037) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:34:27 devstack cinder-volume[75037]: DEBUG cinder.volume.manager [None req-56f5b95c-ba0f-4863-a562-8058f071297c None None] thread info: [<_MainThread(MainThread, started 127944132300928)>, , , , , ] {{(pid=75037) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:34:36 devstack cinder-volume[75037]: DEBUG dbcounter [-] [75037] Writing DB stats cinder:SELECT=1 {{(pid=75037) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:34:36 devstack cinder-volume[75037]: DEBUG dbcounter [-] [75037] Writing DB stats cinder:UPDATE=1 {{(pid=75037) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:34:46 devstack cinder-volume[74877]: INFO oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Caught SIGTERM, stopping children Sep 16 17:34:46 devstack cinder-volume[74877]: DEBUG oslo_concurrency.lockutils [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Acquiring lock "singleton_lock" {{(pid=74877) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 16 17:34:46 devstack cinder-volume[74877]: DEBUG oslo_concurrency.lockutils [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Acquired lock "singleton_lock" {{(pid=74877) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 16 17:34:46 devstack cinder-volume[74877]: DEBUG oslo_concurrency.lockutils [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Releasing lock "singleton_lock" {{(pid=74877) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 16 17:34:46 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Stop services. {{(pid=74877) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 16 17:34:46 devstack cinder-volume[74877]: DEBUG oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Killing children. {{(pid=74877) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 16 17:34:46 devstack cinder-volume[74877]: INFO oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Waiting on 1 children to exit Sep 16 17:34:50 devstack cinder-volume[75037]: DEBUG oslo_concurrency.lockutils [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Acquiring lock "singleton_lock" {{(pid=75037) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 16 17:34:50 devstack cinder-volume[75037]: DEBUG oslo_concurrency.lockutils [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Acquired lock "singleton_lock" {{(pid=75037) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 16 17:34:50 devstack cinder-volume[75037]: DEBUG oslo_concurrency.lockutils [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Releasing lock "singleton_lock" {{(pid=75037) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 16 17:34:50 devstack cinder-volume[75037]: WARNING amqp [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 16 17:34:50 devstack cinder-volume[75037]: WARNING amqp [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 16 17:34:50 devstack cinder-volume[74877]: INFO oslo_service.backend._eventlet.service [None req-f0db1b52-ecc2-4538-aca5-699d6071caa3 None None] Child 75037 exited with status 0 Sep 16 17:34:51 devstack cinder-volume[85072]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 16 17:34:51 devstack cinder-volume[85072]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 16 17:34:51 devstack cinder-volume[85072]: we strongly recommend against using it for new projects. Sep 16 17:34:51 devstack cinder-volume[85072]: If you are already using Eventlet, we recommend migrating to a different Sep 16 17:34:51 devstack cinder-volume[85072]: framework. For more detail see Sep 16 17:34:51 devstack cinder-volume[85072]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 16 17:34:51 devstack cinder-volume[85072]: import eventlet # noqa Sep 16 17:34:53 devstack cinder-volume[85072]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85072) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 16 17:34:53 devstack cinder-volume[85072]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85072) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 16 17:34:53 devstack cinder-volume[85072]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85072) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 16 17:34:53 devstack cinder-volume[85072]: INFO dbcounter [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Registered counter for database cinder Sep 16 17:34:53 devstack cinder-volume[85072]: DEBUG oslo_db.sqlalchemy.engines [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85072) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG dbcounter [-] [85072] Writer thread running {{(pid=85072) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 16 17:34:54 devstack cinder-volume[85072]: INFO cinder.rpc [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 16 17:34:54 devstack cinder-volume[85072]: INFO cinder.rpc [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_db.sqlalchemy.engines [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85072) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 17:34:54 devstack cinder-volume[85072]: INFO cinder.volume.manager [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Determined volume DB was empty at startup. Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG cinder.volume.manager [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85072) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 16 17:34:54 devstack cinder-volume[85072]: INFO cinder.volume.manager [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 16 17:34:54 devstack cinder-volume[85072]: WARNING stevedore.named [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 17:34:54 devstack cinder-volume[85072]: WARNING castellan.key_manager [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 17:34:54 devstack cinder-volume[85072]: WARNING cinder.keymgr.conf_key_mgr [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 17:34:54 devstack cinder-volume[85072]: INFO cinder.volume.manager [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_db.sqlalchemy.engines [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85072) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 17:34:54 devstack cinder-volume[85072]: INFO oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Starting 1 workers Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Started child 85285 {{(pid=85072) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Full set of CONF: {{(pid=85072) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] ******************************************************************************** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Configuration options gathered from: {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] ================================================================================ {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 16 17:34:54 devstack cinder-volume[85285]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] allow_availability_zone_fallback = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] allow_compression_on_image_upload = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] allowed_direct_url_schemes = [] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] api_rate_limit = True {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] auth_strategy = keystone {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_availability_zone = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_host = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_name = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_stats_polling_interval = 60 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backup_api_class = cinder.backup.api.API {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backup_name_template = backup-%s {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backup_use_same_host = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backup_use_temp_snapshot = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] chap_password = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] chap_username = {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cinder_internal_tenant_project_id = 04e27bfa226f4efbb561447660fd53be {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cinder_internal_tenant_user_id = 4a094ff0475b4683ad5d04a1156cffbe {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cluster = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] compression_format = gzip {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] compute_api_class = cinder.compute.nova.API {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] config_dir = [] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] config_source = [] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] control_exchange = openstack {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] debug = True {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] default_availability_zone = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] default_group_type = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] default_volume_type = QuobyteHD {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] disk_geometry = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] driver_client_cert = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] driver_client_cert_key = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] driver_data_namespace = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] driver_ssl_cert_path = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] driver_ssl_cert_verify = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] driver_use_ssl = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] enable_new_services = True {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] enable_unsupported_driver = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] enabled_backends = ['QuobyteHD'] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] enforce_multipath_for_image_xfer = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] filter_function = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] glance_api_insecure = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] glance_api_servers = ['http://192.168.122.235/image'] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] glance_api_ssl_compression = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] glance_ca_certificates_file = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] glance_catalog_info = image:glance:publicURL {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] glance_certfile = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] glance_keyfile = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] glance_num_retries = 3 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] glance_request_timeout = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] goodness_function = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] graceful_shutdown_timeout = 5 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] group_api_class = cinder.group.api.API {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] host = devstack {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] image_compress_on_upload = True {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] image_conversion_address_space_limit = 1 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] image_conversion_cpu_limit = 60 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] image_conversion_disable = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] image_upload_use_cinder_backend = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] image_upload_use_internal_tenant = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] image_volume_cache_enabled = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] image_volume_cache_max_count = 0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] image_volume_cache_max_size_gb = 0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] init_host_max_objects_retrieval = 0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] instance_format = [instance: %(uuid)s] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] iscsi_target_flags = {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] iscsi_write_cache = on {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] iser_helper = tgtadm {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] iser_ip_address = 192.168.122.235 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85285]: INFO cinder.volume.manager [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Starting volume driver QuobyteDriver (1.2.1) Sep 16 17:34:54 devstack cinder-volume[85285]: DEBUG cinder.volume.drivers.remotefs [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85285) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] iser_port = 3260 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] log_color = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] log_config_append = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] log_dir = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] log_file = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] log_options = True {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] log_rotate_interval = 1 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] log_rotate_interval_type = days {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] log_rotation_type = none {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] max_age = 0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] max_logfile_count = 30 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] max_logfile_size_mb = 200 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] max_over_subscription_ratio = 20.0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] message_reap_interval = 86400 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] message_ttl = 2592000 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] migration_create_volume_timeout_secs = 300 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] monkey_patch = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] monkey_patch_modules = [] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] my_ip = 192.168.122.235 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] no_snapshot_gb_quota = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] num_iser_scan_tries = 3 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] num_shell_tries = 3 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] num_volume_device_scan_tries = 3 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] nvmeof_conn_info_version = 1 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] nvmet_ns_id = 10 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] nvmet_port_id = 1 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] osapi_max_limit = 1000 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] osapi_volume_ext_list = [] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] osapi_volume_listen_port = 8776 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] osapi_volume_use_ssl = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] osapi_volume_workers = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] per_volume_size_limit = -1 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] periodic_fuzzy_delay = 60 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] periodic_interval = 60 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] public_endpoint = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] publish_errors = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] quota_backup_gigabytes = 1000 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] quota_backups = 10 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] quota_gigabytes = 1000 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] quota_groups = 10 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] quota_snapshots = 10 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] quota_volumes = 10 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] rate_limit_burst = 0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] rate_limit_except_level = CRITICAL {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] rate_limit_interval = 0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] reinit_driver_count = 3 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] replication_device = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] report_discard_supported = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] report_interval = 120 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] reservation_clean_interval = 86400 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] reservation_expire = 86400 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] reserved_image_namespaces = [] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] reserved_percentage = 0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] rpc_response_timeout = 120 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] run_external_periodic_tasks = True {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] scst_target_driver = iscsi {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] scst_target_iqn_name = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] service_down_time = 720 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] shell_completion = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] snapshot_name_template = snapshot-%s {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] split_loggers = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] state_path = /opt/stack/data/cinder {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] storage_availability_zone = nova {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] storage_protocol = iSCSI {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] syslog_log_facility = LOG_USER {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] target_helper = lioadm {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] target_ip_address = 192.168.122.235 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] target_port = 3260 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] target_protocol = iscsi {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] target_secondary_ip_addresses = [] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] trace_flags = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] transport_url = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] until_refresh = 0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] use_chap_auth = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] use_default_quota_class = True {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] use_journal = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] use_json = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] use_multipath_for_image_xfer = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] use_stderr = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] use_syslog = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] verify_glance_signatures = enabled {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] volume_api_class = cinder.volume.api.API {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] volume_backend_name = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85285]: DEBUG cinder.volume.drivers.quobyte [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85285) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 16 17:34:54 devstack cinder-volume[85285]: WARNING cinder.volume.drivers.quobyte [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 16 17:34:54 devstack cinder-volume[85285]: WARNING cinder.volume.drivers.quobyte [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] volume_clear = zero {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] volume_clear_ionice = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85285]: DEBUG oslo_concurrency.processutils [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Running cmd (subprocess): mount.quobyte {{(pid=85285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] volume_clear_size = 0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] volume_copy_bps_limit = 0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] volume_dd_blocksize = 1M {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] volume_name_template = volume-%s {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] volume_service_inithost_offload = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] volume_usage_audit_period = month {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] zoning_mode = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_concurrency.disable_process_locking = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.auth_section = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.auth_type = password {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.auth_version = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.cache = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.certfile = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.include_service_catalog = True {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.insecure = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.interface = public {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.keyfile = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.memcache_password = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.memcache_username = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.region_name = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.service_type = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.235/identity {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.backend = dogpile.cache.null {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.backend_argument = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.backend_expiration_time = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.config_prefix = cache.oslo {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.debug_cache_backend = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.enable_retry_client = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.enable_socket_keepalive = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.enabled = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.expiration_time = 600 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.hashclient_retry_attempts = 2 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.memcache_dead_retry = 300 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.memcache_pool_maxsize = 10 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.memcache_sasl_enabled = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.password = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.proxies = [] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.redis_db = 0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.redis_server = localhost:6379 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.retry_attempts = 2 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.retry_delay = 0.0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.socket_keepalive_count = 1 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.socket_keepalive_idle = 1 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.socket_keepalive_interval = 1 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.socket_timeout = 1.0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.tls_allowed_ciphers = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.tls_cafile = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.tls_certfile = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.tls_enabled = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.tls_keyfile = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cache.username = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] coordination.backend_url = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] database.asyncio_connection = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] database.asyncio_slave_connection = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] database.backend = sqlalchemy {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] database.connection = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] database.connection_debug = 0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] database.connection_parameters = {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] database.connection_recycle_time = 3600 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] database.connection_trace = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] database.db_inc_retry_interval = True {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] database.db_max_retries = 20 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] database.db_max_retry_interval = 10 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] database.db_retry_interval = 1 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] database.max_overflow = 50 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] database.max_pool_size = 5 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] database.max_retries = 10 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] database.mysql_wsrep_sync_wait = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] database.pool_timeout = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] database.retry_interval = 10 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] database.slave_connection = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] database.sqlite_synchronous = True {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] database.synchronous_reader = True {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] database.use_db_reconnect = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_tracing.insecure = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] profiler.connection_string = messaging:// {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] profiler.enabled = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] profiler.es_doc_type = notification {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] profiler.es_scroll_size = 10000 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] profiler.es_scroll_time = 2m {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] profiler.filter_error_trace = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] profiler.hmac_keys = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] profiler.sentinel_service_name = mymaster {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] profiler.socket_timeout = 0.1 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] profiler.trace_requests = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] profiler.trace_sqlalchemy = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] profiler_jaeger.process_tags = {} {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] profiler_jaeger.service_name_prefix = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] profiler_otlp.service_name_prefix = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_policy.enforce_new_defaults = True {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_policy.policy_default_rule = default {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_policy.policy_file = policy.yaml {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] privsep_osbrick.group = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] privsep_osbrick.helper_command = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] privsep_osbrick.user = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cinder_sys_admin.group = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cinder_sys_admin.helper_command = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] cinder_sys_admin.user = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] service_user.auth_section = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] service_user.auth_type = password {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] service_user.cafile = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] service_user.certfile = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] service_user.collect_timing = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] service_user.insecure = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] service_user.keyfile = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] service_user.send_service_user_token = True {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] service_user.split_loggers = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] service_user.timeout = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] service_user.tls_ciphers = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] service_user.tls_min_version = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] glance.auth_section = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] glance.auth_type = password {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] glance.certfile = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] glance.collect_timing = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] glance.insecure = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] glance.keyfile = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] glance.region_name = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] glance.split_loggers = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] glance.timeout = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] glance.tls_ciphers = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] glance.tls_min_version = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.backend_availability_zone = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.chap_password = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.chap_username = {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.disk_geometry = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.driver_client_cert = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.driver_client_cert_key = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.driver_data_namespace = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.driver_use_ssl = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.extra_capabilities = {} {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.filter_function = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.goodness_function = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.iscsi_target_flags = {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.iscsi_write_cache = on {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.iser_helper = tgtadm {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.iser_ip_address = 192.168.122.235 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.iser_port = 3260 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.nas_host = {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.nas_login = admin {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.nas_mount_options = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.nas_password = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.nas_private_key = {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.nas_share_path = {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.num_shell_tries = 3 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.quobyte_volume_url = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.replication_device = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.report_discard_supported = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.reserved_percentage = 0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.target_helper = tgtadm {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.target_ip_address = 192.168.122.235 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.target_port = 3260 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.target_protocol = iscsi {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.trace_flags = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.unique_fqdn_network = True {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.use_chap_auth = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.volume_backend_name = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.volume_clear = zero {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.volume_clear_ionice = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.volume_clear_size = 0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_reports.file_event_handler = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_reports.log_dir = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.backend_availability_zone = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.backend_host = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.chap_password = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.chap_username = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.chiscsi_conf = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.disk_geometry = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.driver_client_cert = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.driver_data_namespace = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.driver_use_ssl = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.extra_capabilities = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.filter_function = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.goodness_function = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.iser_helper = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.iser_ip_address = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.iser_port = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.iser_target_prefix = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.nas_host = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.nas_login = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85285]: DEBUG oslo_concurrency.processutils [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] CMD "mount.quobyte" returned: 1 in 0.131s {{(pid=85285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.nas_mount_options = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.nas_password = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.nas_private_key = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85285) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85285) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85285]: DEBUG cinder.volume.drivers.quobyte [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85285) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.nas_share_path = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.nas_ssh_port = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.num_shell_tries = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.nvmet_port_id = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85285]: INFO cinder.volume.drivers.quobyte [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 ... Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.replication_device = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.report_discard_supported = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85285]: DEBUG oslo_concurrency.processutils [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 -c /etc/quobyte/client-cinder.cfg {{(pid=85285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.reserved_percentage = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.scst_target_driver = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.storage_protocol = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.target_helper = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.target_ip_address = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.target_port = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.target_prefix = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.target_protocol = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.trace_flags = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.use_chap_auth = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.volume_clear = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.volume_clear_size = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] QuobyteHD.volumes_dir = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.ssl = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_notifications.driver = [] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_notifications.retry = -1 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] key_manager.fixed_key = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican.barbican_api_version = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican.barbican_endpoint = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican.barbican_endpoint_type = public {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican.barbican_region_name = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican.cafile = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican.certfile = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican.collect_timing = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican.insecure = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican.keyfile = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican.number_of_retries = 60 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican.retry_delay = 1 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican.send_service_user_token = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican.split_loggers = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican.timeout = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican.tls_ciphers = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican.tls_min_version = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican.verify_ssl = True {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican.verify_ssl_path = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican_service_user.auth_section = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican_service_user.auth_type = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican_service_user.cafile = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican_service_user.certfile = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican_service_user.collect_timing = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican_service_user.insecure = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican_service_user.keyfile = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican_service_user.split_loggers = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican_service_user.timeout = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican_service_user.tls_ciphers = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] barbican_service_user.tls_min_version = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] vault.approle_role_id = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] vault.approle_secret_id = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] vault.auth_method = approle {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] vault.auth_path = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] vault.kv_mountpoint = secret {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] vault.kv_path = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] vault.kv_version = 2 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] vault.namespace = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] vault.root_token_id = **** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] vault.ssl_ca_crt_file = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] vault.timeout = 60.0 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] vault.token_file = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] vault.token_role = None {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] vault.use_ssl = False {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:34:54 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] ******************************************************************************** {{(pid=85072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 16 17:34:55 devstack sudo[85291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 -c /etc/quobyte/client-cinder.cfg Sep 16 17:34:55 devstack sudo[85291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:34:55 devstack sudo[85291]: pam_unix(sudo:session): session closed for user root Sep 16 17:34:55 devstack cinder-volume[85285]: DEBUG oslo_concurrency.processutils [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.421s {{(pid=85285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:34:55 devstack cinder-volume[85285]: INFO cinder.volume.drivers.quobyte [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 succeeded Sep 16 17:34:55 devstack cinder-volume[85285]: DEBUG cinder.volume.drivers.quobyte [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85285) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:34:55 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.436s {{(pid=85285) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:34:55 devstack cinder-volume[85285]: DEBUG oslo_concurrency.processutils [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:34:55 devstack sudo[85390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:34:55 devstack sudo[85390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:34:55 devstack sudo[85390]: pam_unix(sudo:session): session closed for user root Sep 16 17:34:55 devstack cinder-volume[85285]: DEBUG oslo_concurrency.processutils [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.262s {{(pid=85285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:34:55 devstack cinder-volume[85285]: INFO cinder.volume.driver [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Driver hasn't implemented _init_vendor_properties() Sep 16 17:34:55 devstack cinder-volume[85285]: DEBUG cinder.volume.driver [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.786506652832, 'free_capacity_gb': 1775.786506652832, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85285) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 16 17:34:55 devstack cinder-volume[85285]: DEBUG oslo_db.sqlalchemy.engines [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85285) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 17:34:55 devstack cinder-volume[85285]: DEBUG dbcounter [-] [85285] Writer thread running {{(pid=85285) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 16 17:34:55 devstack cinder-volume[85285]: DEBUG cinder.db.api [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Building query based on filter {{(pid=85285) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 16 17:34:55 devstack cinder-volume[85285]: DEBUG cinder.image.image_utils [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85285) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 16 17:34:55 devstack cinder-volume[85285]: INFO cinder.keymgr.migration [None req-52a74401-6513-4f32-97ac-8e719692d135 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 16 17:34:55 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85285) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:34:55 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85285) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:34:55 devstack cinder-volume[85285]: DEBUG cinder.volume.drivers.quobyte [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85285) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:34:55 devstack cinder-volume[85285]: DEBUG cinder.volume.drivers.quobyte [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85285) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:34:55 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85285) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:34:55 devstack cinder-volume[85285]: DEBUG oslo_concurrency.processutils [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:34:55 devstack sudo[85393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:34:55 devstack sudo[85393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:34:56 devstack sudo[85393]: pam_unix(sudo:session): session closed for user root Sep 16 17:34:56 devstack cinder-volume[85285]: DEBUG oslo_concurrency.processutils [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.245s {{(pid=85285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:34:56 devstack cinder-volume[85285]: DEBUG cinder.manager [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Notifying Schedulers of capabilities ... {{(pid=85285) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:34:56 devstack cinder-volume[85285]: INFO cinder.volume.manager [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Driver initialization completed successfully. Sep 16 17:34:56 devstack cinder-volume[85285]: INFO cinder.manager [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Initiating service 3 cleanup Sep 16 17:34:56 devstack cinder-volume[85285]: INFO cinder.manager [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Service 3 cleanup completed. Sep 16 17:34:56 devstack cinder-volume[85285]: DEBUG cinder.service [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Creating RPC server for service cinder-volume {{(pid=85285) start /opt/stack/cinder/cinder/service.py:231}} Sep 16 17:34:56 devstack cinder-volume[85285]: DEBUG cinder.service [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85285) start /opt/stack/cinder/cinder/service.py:237}} Sep 16 17:34:56 devstack cinder-volume[85285]: INFO cinder.volume.manager [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 16 17:34:56 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85285) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:34:56 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85285) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:34:56 devstack cinder-volume[85285]: DEBUG cinder.volume.drivers.quobyte [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85285) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:34:56 devstack cinder-volume[85285]: DEBUG cinder.volume.drivers.quobyte [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85285) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:34:56 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85285) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:34:56 devstack cinder-volume[85285]: DEBUG oslo_concurrency.processutils [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:34:56 devstack sudo[85396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:34:56 devstack sudo[85396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:34:56 devstack sudo[85396]: pam_unix(sudo:session): session closed for user root Sep 16 17:34:56 devstack cinder-volume[85285]: DEBUG oslo_concurrency.processutils [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.264s {{(pid=85285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:34:56 devstack cinder-volume[85285]: INFO cinder.volume.manager [None req-4ead6784-8cc0-435c-b45c-e4ab9dff51ec None None] Driver post RPC initialization completed successfully. Sep 16 17:35:01 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [None req-aa558619-678f-401b-b56f-0fcab120de1f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85285) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:35:01 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [None req-aa558619-678f-401b-b56f-0fcab120de1f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85285) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:35:01 devstack cinder-volume[85285]: DEBUG cinder.volume.drivers.quobyte [None req-aa558619-678f-401b-b56f-0fcab120de1f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85285) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:35:01 devstack cinder-volume[85285]: DEBUG cinder.volume.drivers.quobyte [None req-aa558619-678f-401b-b56f-0fcab120de1f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85285) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:35:01 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [None req-aa558619-678f-401b-b56f-0fcab120de1f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85285) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:35:01 devstack cinder-volume[85285]: DEBUG oslo_concurrency.processutils [None req-aa558619-678f-401b-b56f-0fcab120de1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:35:01 devstack sudo[85544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:35:01 devstack sudo[85544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:35:01 devstack sudo[85544]: pam_unix(sudo:session): session closed for user root Sep 16 17:35:01 devstack cinder-volume[85285]: DEBUG oslo_concurrency.processutils [None req-aa558619-678f-401b-b56f-0fcab120de1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.243s {{(pid=85285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:35:01 devstack cinder-volume[85285]: DEBUG cinder.manager [None req-aa558619-678f-401b-b56f-0fcab120de1f None None] Notifying Schedulers of capabilities ... {{(pid=85285) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:35:01 devstack cinder-volume[85072]: INFO oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Caught SIGTERM, stopping children Sep 16 17:35:01 devstack cinder-volume[85072]: DEBUG oslo_concurrency.lockutils [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Acquiring lock "singleton_lock" {{(pid=85072) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 16 17:35:01 devstack cinder-volume[85072]: DEBUG oslo_concurrency.lockutils [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Acquired lock "singleton_lock" {{(pid=85072) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 16 17:35:01 devstack cinder-volume[85072]: DEBUG oslo_concurrency.lockutils [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Releasing lock "singleton_lock" {{(pid=85072) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 16 17:35:01 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Stop services. {{(pid=85072) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 16 17:35:01 devstack cinder-volume[85072]: DEBUG oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Killing children. {{(pid=85072) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 16 17:35:01 devstack cinder-volume[85072]: INFO oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Waiting on 1 children to exit Sep 16 17:35:04 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Acquiring lock "singleton_lock" {{(pid=85285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 16 17:35:04 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Acquired lock "singleton_lock" {{(pid=85285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 16 17:35:04 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Releasing lock "singleton_lock" {{(pid=85285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 16 17:35:04 devstack cinder-volume[85285]: WARNING amqp [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 16 17:35:04 devstack cinder-volume[85285]: WARNING amqp [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 16 17:35:04 devstack cinder-volume[85072]: INFO oslo_service.backend._eventlet.service [None req-a3376e0f-445b-4a2b-b63e-9c55b14ef4f1 None None] Child 85285 exited with status 0 Sep 16 17:35:05 devstack cinder-volume[85601]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 16 17:35:05 devstack cinder-volume[85601]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 16 17:35:05 devstack cinder-volume[85601]: we strongly recommend against using it for new projects. Sep 16 17:35:05 devstack cinder-volume[85601]: If you are already using Eventlet, we recommend migrating to a different Sep 16 17:35:05 devstack cinder-volume[85601]: framework. For more detail see Sep 16 17:35:05 devstack cinder-volume[85601]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 16 17:35:05 devstack cinder-volume[85601]: import eventlet # noqa Sep 16 17:35:08 devstack cinder-volume[85601]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85601) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 16 17:35:08 devstack cinder-volume[85601]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85601) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 16 17:35:08 devstack cinder-volume[85601]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85601) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 16 17:35:09 devstack cinder-volume[85601]: INFO dbcounter [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] Registered counter for database cinder Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_db.sqlalchemy.engines [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85601) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG dbcounter [-] [85601] Writer thread running {{(pid=85601) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 16 17:35:09 devstack cinder-volume[85601]: INFO cinder.rpc [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 16 17:35:09 devstack cinder-volume[85601]: INFO cinder.rpc [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_db.sqlalchemy.engines [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85601) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 17:35:09 devstack cinder-volume[85601]: INFO cinder.volume.manager [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] Determined volume DB was empty at startup. Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG cinder.volume.manager [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85601) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 16 17:35:09 devstack cinder-volume[85601]: WARNING stevedore.named [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 17:35:09 devstack cinder-volume[85601]: WARNING castellan.key_manager [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 17:35:09 devstack cinder-volume[85601]: WARNING cinder.keymgr.conf_key_mgr [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 17:35:09 devstack cinder-volume[85601]: INFO cinder.volume.manager [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_db.sqlalchemy.engines [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85601) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 17:35:09 devstack cinder-volume[85601]: INFO oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] Starting 1 workers Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] Started child 85899 {{(pid=85601) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] Full set of CONF: {{(pid=85601) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] ******************************************************************************** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] Configuration options gathered from: {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] ================================================================================ {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] allow_availability_zone_fallback = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] allow_compression_on_image_upload = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] allowed_direct_url_schemes = [] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] api_rate_limit = True {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] auth_strategy = keystone {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_availability_zone = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_host = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_name = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_stats_polling_interval = 60 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backup_api_class = cinder.backup.api.API {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backup_name_template = backup-%s {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backup_use_same_host = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backup_use_temp_snapshot = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] chap_password = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] chap_username = {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cinder_internal_tenant_project_id = 04e27bfa226f4efbb561447660fd53be {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cinder_internal_tenant_user_id = 4a094ff0475b4683ad5d04a1156cffbe {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cluster = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85899]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] compression_format = gzip {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] compute_api_class = cinder.compute.nova.API {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] config_dir = [] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] config_source = [] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] control_exchange = openstack {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] debug = True {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] default_availability_zone = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] default_group_type = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] default_volume_type = QuobyteHD {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] disk_geometry = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] driver_client_cert = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] driver_client_cert_key = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] driver_data_namespace = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] driver_ssl_cert_path = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] driver_ssl_cert_verify = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] driver_use_ssl = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] enable_new_services = True {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] enable_unsupported_driver = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] enabled_backends = ['QuobyteHD'] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] enforce_multipath_for_image_xfer = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] filter_function = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] glance_api_insecure = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] glance_api_servers = ['http://192.168.122.235/image'] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] glance_api_ssl_compression = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] glance_ca_certificates_file = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] glance_catalog_info = image:glance:publicURL {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] glance_certfile = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] glance_keyfile = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] glance_num_retries = 3 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] glance_request_timeout = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] goodness_function = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] graceful_shutdown_timeout = 5 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] group_api_class = cinder.group.api.API {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] host = devstack {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] image_compress_on_upload = True {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] image_conversion_address_space_limit = 1 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] image_conversion_cpu_limit = 60 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] image_conversion_disable = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] image_upload_use_cinder_backend = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] image_upload_use_internal_tenant = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] image_volume_cache_enabled = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] image_volume_cache_max_count = 0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] image_volume_cache_max_size_gb = 0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] init_host_max_objects_retrieval = 0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] instance_format = [instance: %(uuid)s] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] iscsi_target_flags = {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] iscsi_write_cache = on {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] iser_helper = tgtadm {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] iser_ip_address = 192.168.122.235 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] iser_port = 3260 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] log_color = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] log_config_append = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] log_dir = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] log_file = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] log_options = True {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] log_rotate_interval = 1 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] log_rotate_interval_type = days {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] log_rotation_type = none {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] max_age = 0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] max_logfile_count = 30 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] max_logfile_size_mb = 200 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] max_over_subscription_ratio = 20.0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] message_reap_interval = 86400 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] message_ttl = 2592000 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] migration_create_volume_timeout_secs = 300 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] monkey_patch = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] monkey_patch_modules = [] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] my_ip = 192.168.122.235 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] no_snapshot_gb_quota = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] num_iser_scan_tries = 3 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] num_shell_tries = 3 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] num_volume_device_scan_tries = 3 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] nvmeof_conn_info_version = 1 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] nvmet_ns_id = 10 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] nvmet_port_id = 1 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] osapi_max_limit = 1000 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] osapi_volume_ext_list = [] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] osapi_volume_listen = 0.0.0.0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] osapi_volume_listen_port = 8776 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] osapi_volume_use_ssl = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] osapi_volume_workers = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] per_volume_size_limit = -1 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] periodic_fuzzy_delay = 60 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] periodic_interval = 60 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] project_id_regex = [0-9a-f\-]+ {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] public_endpoint = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] publish_errors = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] quota_backup_gigabytes = 1000 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] quota_backups = 10 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] quota_gigabytes = 1000 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] quota_groups = 10 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] quota_snapshots = 10 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] quota_volumes = 10 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] rate_limit_burst = 0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] rate_limit_except_level = CRITICAL {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] rate_limit_interval = 0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] reinit_driver_count = 3 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] replication_device = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] report_discard_supported = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] report_interval = 120 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] reservation_clean_interval = 86400 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] reservation_expire = 86400 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] reserved_image_namespaces = [] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] reserved_percentage = 0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] rpc_response_timeout = 120 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] run_external_periodic_tasks = True {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] scst_target_driver = iscsi {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] scst_target_iqn_name = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] service_down_time = 720 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] shell_completion = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] snapshot_name_template = snapshot-%s {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] split_loggers = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] state_path = /opt/stack/data/cinder {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] storage_availability_zone = nova {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] storage_protocol = iSCSI {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] syslog_log_facility = LOG_USER {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] target_helper = lioadm {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] target_ip_address = 192.168.122.235 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] target_port = 3260 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] target_protocol = iscsi {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:09 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] target_secondary_ip_addresses = [] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] trace_flags = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] transfer_api_class = cinder.transfer.api.API {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] transport_url = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] until_refresh = 0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] use_chap_auth = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] use_default_quota_class = True {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] use_journal = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] use_json = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] use_multipath_for_image_xfer = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] use_stderr = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] use_syslog = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] verify_glance_signatures = enabled {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] volume_api_class = cinder.volume.api.API {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] volume_backend_name = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] volume_clear = zero {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] volume_clear_ionice = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85899) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] volume_clear_size = 0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] volume_copy_bps_limit = 0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] volume_dd_blocksize = 1M {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] volume_name_template = volume-%s {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] volume_service_inithost_offload = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] volume_usage_audit_period = month {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] zoning_mode = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_concurrency.disable_process_locking = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.auth_section = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.auth_type = password {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.auth_version = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.cache = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.certfile = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.delay_auth_decision = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.http_connect_timeout = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.include_service_catalog = True {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.insecure = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.interface = public {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.keyfile = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.memcache_password = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.memcache_username = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.region_name = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.service_token_roles_required = True {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.service_type = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.token_cache_time = 300 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.235/identity {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.backend = dogpile.cache.null {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.backend_argument = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.backend_expiration_time = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.config_prefix = cache.oslo {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.debug_cache_backend = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.enable_retry_client = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.enable_socket_keepalive = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.enabled = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.expiration_time = 600 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.hashclient_retry_attempts = 2 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.memcache_dead_retry = 300 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.memcache_pool_maxsize = 10 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.memcache_sasl_enabled = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.password = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.proxies = [] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.redis_db = 0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.redis_sentinel_service_name = mymaster {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.redis_server = localhost:6379 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.retry_attempts = 2 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.retry_delay = 0.0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.socket_keepalive_count = 1 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.socket_keepalive_idle = 1 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.socket_keepalive_interval = 1 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.socket_timeout = 1.0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.tls_allowed_ciphers = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.tls_cafile = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.tls_certfile = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.tls_enabled = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.tls_keyfile = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cache.username = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] coordination.backend_url = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] database.asyncio_connection = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] database.asyncio_slave_connection = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] database.backend = sqlalchemy {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] database.connection = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] database.connection_debug = 0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] database.connection_parameters = {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] database.connection_recycle_time = 3600 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] database.connection_trace = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] database.db_inc_retry_interval = True {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] database.db_max_retries = 20 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] database.db_max_retry_interval = 10 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] database.db_retry_interval = 1 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] database.max_overflow = 50 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] database.max_pool_size = 5 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] database.max_retries = 10 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] database.mysql_wsrep_sync_wait = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] database.pool_timeout = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] database.retry_interval = 10 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] database.slave_connection = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] database.sqlite_synchronous = True {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] database.synchronous_reader = True {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] database.use_db_reconnect = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_tracing.insecure = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] profiler.connection_string = messaging:// {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] profiler.enabled = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] profiler.es_doc_type = notification {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] profiler.es_scroll_size = 10000 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] profiler.es_scroll_time = 2m {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] profiler.filter_error_trace = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] profiler.hmac_keys = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] profiler.sentinel_service_name = mymaster {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] profiler.socket_timeout = 0.1 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] profiler.trace_requests = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] profiler.trace_sqlalchemy = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] profiler_jaeger.process_tags = {} {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] profiler_jaeger.service_name_prefix = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] profiler_otlp.service_name_prefix = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_policy.enforce_new_defaults = True {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_policy.policy_default_rule = default {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_policy.policy_file = policy.yaml {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_policy.remote_timeout = 60.0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] privsep_osbrick.group = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] privsep_osbrick.helper_command = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] privsep_osbrick.user = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cinder_sys_admin.group = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cinder_sys_admin.helper_command = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] cinder_sys_admin.user = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] service_user.auth_section = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] service_user.auth_type = password {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] service_user.cafile = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] service_user.certfile = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] service_user.collect_timing = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] service_user.insecure = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] service_user.keyfile = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] service_user.send_service_user_token = True {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] service_user.split_loggers = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] service_user.timeout = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] service_user.tls_ciphers = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] service_user.tls_min_version = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] glance.auth_section = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] glance.auth_type = password {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] glance.certfile = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] glance.collect_timing = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] glance.insecure = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] glance.keyfile = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] glance.region_name = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] glance.split_loggers = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] glance.timeout = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] glance.tls_ciphers = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] glance.tls_min_version = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.backend_availability_zone = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.chap_password = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.chap_username = {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.disk_geometry = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.driver_client_cert = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.driver_client_cert_key = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.driver_data_namespace = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.driver_use_ssl = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.enable_unsupported_driver = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85899) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.quobyte [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 16 17:35:10 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.quobyte [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Running cmd (subprocess): mount.quobyte {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.extra_capabilities = {} {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.filter_function = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.goodness_function = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.iscsi_target_flags = {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.iscsi_write_cache = on {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.iser_helper = tgtadm {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.iser_ip_address = 192.168.122.235 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.iser_port = 3260 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.nas_host = {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.nas_login = admin {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.nas_mount_options = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.nas_password = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.nas_private_key = {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.nas_share_path = {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.nas_ssh_port = 22 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.num_shell_tries = 3 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.nvmet_port_id = 1 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.quobyte_client_cfg = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.quobyte_volume_url = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.replication_device = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.report_discard_supported = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.reserved_percentage = 0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.scst_target_driver = iscsi {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.scst_target_iqn_name = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.storage_protocol = iSCSI {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.target_helper = tgtadm {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.target_ip_address = 192.168.122.235 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.target_port = 3260 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.target_protocol = iscsi {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.trace_flags = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.unique_fqdn_network = True {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.use_chap_auth = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.volume_backend_name = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.volume_clear = zero {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.volume_clear_ionice = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.volume_clear_size = 0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_reports.file_event_handler = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_reports.log_dir = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.backend_availability_zone = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.backend_host = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.chap_password = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.chap_username = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.chiscsi_conf = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.disk_geometry = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.driver_client_cert = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.driver_client_cert_key = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.driver_data_namespace = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.driver_use_ssl = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.extra_capabilities = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.filter_function = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.goodness_function = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.iscsi_target_flags = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.iscsi_write_cache = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.iser_helper = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.iser_ip_address = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.iser_port = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.iser_target_prefix = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.nas_host = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.nas_login = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.nas_mount_options = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.nas_password = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.nas_private_key = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack quobyte-client[85901]: Reading configuration file: /etc/quobyte/client.cfg Sep 16 17:35:10 devstack quobyte-client[85901]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.nas_share_path = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.nas_ssh_port = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.num_shell_tries = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.nvmet_ns_id = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.nvmet_port_id = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.replication_device = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.report_discard_supported = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.reserved_percentage = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.scst_target_driver = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.storage_protocol = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.target_helper = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.target_ip_address = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.target_port = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.target_prefix = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.target_protocol = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.trace_flags = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.unique_fqdn_network = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.use_chap_auth = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.volume_clear = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.volume_clear_ionice = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.volume_clear_size = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] QuobyteHD.volumes_dir = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.ssl = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.ssl_version = {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_notifications.driver = [] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_notifications.retry = -1 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] oslo_messaging_notifications.transport_url = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] key_manager.fixed_key = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican.barbican_api_version = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican.barbican_endpoint = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican.barbican_endpoint_type = public {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican.barbican_region_name = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican.cafile = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican.certfile = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican.collect_timing = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican.insecure = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican.keyfile = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican.number_of_retries = 60 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican.retry_delay = 1 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican.send_service_user_token = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican.split_loggers = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican.timeout = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican.tls_ciphers = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican.tls_min_version = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican.verify_ssl = True {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican.verify_ssl_path = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican_service_user.auth_section = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican_service_user.auth_type = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican_service_user.cafile = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican_service_user.certfile = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican_service_user.collect_timing = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican_service_user.insecure = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican_service_user.keyfile = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican_service_user.split_loggers = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican_service_user.timeout = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican_service_user.tls_ciphers = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] barbican_service_user.tls_min_version = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] vault.approle_role_id = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] vault.approle_secret_id = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack sudo[85902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] vault.auth_method = approle {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] vault.auth_path = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] vault.kv_mountpoint = secret {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] vault.kv_path = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack sudo[85902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] vault.kv_version = 2 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] vault.namespace = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] vault.root_token_id = **** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] vault.ssl_ca_crt_file = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] vault.timeout = 60.0 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] vault.token_file = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] vault.token_role = None {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] vault.use_ssl = False {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 17:35:10 devstack cinder-volume[85601]: DEBUG oslo_service.backend._eventlet.service [None req-515de2c6-a9a3-4b5c-8819-9d7f3e5305ef None None] ******************************************************************************** {{(pid=85601) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 16 17:35:10 devstack sudo[85902]: pam_unix(sudo:session): session closed for user root Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.241s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:35:10 devstack cinder-volume[85899]: INFO cinder.volume.driver [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Driver hasn't implemented _init_vendor_properties() Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG cinder.volume.driver [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8084831237793, 'free_capacity_gb': 1775.8084831237793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85899) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG oslo_db.sqlalchemy.engines [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85899) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writer thread running {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG cinder.db.api [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Building query based on filter {{(pid=85899) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85899) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:35:10 devstack cinder-volume[85899]: INFO cinder.keymgr.migration [None req-30e65ce0-d771-4808-8e52-9040be1c250a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 16 17:35:10 devstack sudo[85915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:35:10 devstack sudo[85915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:35:10 devstack sudo[85915]: pam_unix(sudo:session): session closed for user root Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.239s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:35:10 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Driver initialization completed successfully. Sep 16 17:35:10 devstack cinder-volume[85899]: INFO cinder.manager [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Initiating service 3 cleanup Sep 16 17:35:10 devstack cinder-volume[85899]: INFO cinder.manager [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Service 3 cleanup completed. Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG cinder.service [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Creating RPC server for service cinder-volume {{(pid=85899) start /opt/stack/cinder/cinder/service.py:231}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG cinder.service [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85899) start /opt/stack/cinder/cinder/service.py:237}} Sep 16 17:35:10 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:35:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:35:10 devstack sudo[85926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:35:10 devstack sudo[85926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:35:11 devstack sudo[85926]: pam_unix(sudo:session): session closed for user root Sep 16 17:35:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.232s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:35:11 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-f6a4d400-31f1-4588-b8de-3fb24c4a6e75 None None] Driver post RPC initialization completed successfully. Sep 16 17:35:19 devstack cinder-volume[85601]: DEBUG dbcounter [-] [85601] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85601) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:35:20 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:35:21 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=2 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:36:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager._thread_info {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:36:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread count: 6 {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:36:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread info: [<_MainThread(MainThread, started 123748124422272)>, , , , , ] {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:36:14 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:36:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Flow 'volume_create_manager' (e92fac78-7a17-4404-9dbe-9434033c1b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:36:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224a853a-8587-40e9-9e00-9de6e9b20056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:36:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224a853a-8587-40e9-9e00-9de6e9b20056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1266010056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb80850-3c85-4ca1-b3a6-c5a172c8f59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc65892fa294f0881fedc4120e80a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:36:14Z,use_quota=True,user_id='c846f2b40a41435e9537d433a90b1834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:36:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c23ed107-a3f3-45a7-b2eb-ff52f9d7d048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:36:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c23ed107-a3f3-45a7-b2eb-ff52f9d7d048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:36:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e569be08-76d4-4a9a-9b5c-9f8bab872bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:36:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e569be08-76d4-4a9a-9b5c-9f8bab872bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fb80850-3c85-4ca1-b3a6-c5a172c8f59d', 'volume_name': 'volume-3fb80850-3c85-4ca1-b3a6-c5a172c8f59d', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:36:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccc258e-bfcf-4152-b870-6081c50f9808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:36:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccc258e-bfcf-4152-b870-6081c50f9808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:36:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc2638f-580d-4f6d-a15b-920064de0974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:36:14 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Volume 3fb80850-3c85-4ca1-b3a6-c5a172c8f59d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fb80850-3c85-4ca1-b3a6-c5a172c8f59d', 'volume_size': 1} Sep 16 17:36:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:36:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:36:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1266010056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb80850-3c85-4ca1-b3a6-c5a172c8f59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc65892fa294f0881fedc4120e80a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:36:14Z,use_quota=True,user_id='c846f2b40a41435e9537d433a90b1834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:36:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Creating volume 3fb80850-3c85-4ca1-b3a6-c5a172c8f59d {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:36:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:36:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:36:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:36:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:36:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:36:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:36:14 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:36:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3fb80850-3c85-4ca1-b3a6-c5a172c8f59d 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:36:14 devstack sudo[86225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3fb80850-3c85-4ca1-b3a6-c5a172c8f59d 1073741824 Sep 16 17:36:14 devstack sudo[86225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:36:15 devstack sudo[86225]: pam_unix(sudo:session): session closed for user root Sep 16 17:36:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3fb80850-3c85-4ca1-b3a6-c5a172c8f59d 1073741824" returned: 0 in 0.741s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:36:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3fb80850-3c85-4ca1-b3a6-c5a172c8f59d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:36:15 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3fb80850-3c85-4ca1-b3a6-c5a172c8f59d Sep 16 17:36:15 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:36:16 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Sep 16 17:36:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3fb80850-3c85-4ca1-b3a6-c5a172c8f59d" returned: 0 in 0.310s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:36:16 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:36:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:36:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc2638f-580d-4f6d-a15b-920064de0974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fb80850-3c85-4ca1-b3a6-c5a172c8f59d', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:36:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (586384bd-25f7-407a-b58d-e7204a22ec22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:36:16 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Volume volume-3fb80850-3c85-4ca1-b3a6-c5a172c8f59d (3fb80850-3c85-4ca1-b3a6-c5a172c8f59d): created successfully Sep 16 17:36:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (586384bd-25f7-407a-b58d-e7204a22ec22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:36:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Flow 'volume_create_manager' (e92fac78-7a17-4404-9dbe-9434033c1b2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:36:16 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-76e407a7-039b-4c18-afbf-24682bdc8873 tempest-TaggedAttachmentsTest-1428445113 None] Created volume successfully. Sep 16 17:36:26 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:36:26 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:36:34 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:36:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Flow 'volume_create_manager' (d0bbdcb6-2be2-49b9-a638-23314153adc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:36:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3707fa10-db68-4523-8929-f6d2053cf868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:36:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3707fa10-db68-4523-8929-f6d2053cf868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2072742452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a074e629-c7cc-4553-8778-1e75f75c594b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ba19f816964c6c88c0658626157043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:36:34Z,use_quota=True,user_id='4b082b89fbba43dbb4f45910b30cb270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:36:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b074b5c6-01c8-4410-8185-20663f9246fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:36:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b074b5c6-01c8-4410-8185-20663f9246fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:36:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcebcff9-e9ef-43a4-8a3f-7aa556f60577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:36:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcebcff9-e9ef-43a4-8a3f-7aa556f60577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a074e629-c7cc-4553-8778-1e75f75c594b', 'volume_name': 'volume-a074e629-c7cc-4553-8778-1e75f75c594b', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:36:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f224b1f7-917f-41f0-b964-bb1da5999faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:36:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f224b1f7-917f-41f0-b964-bb1da5999faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:36:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98bcd985-ebf3-4535-b30c-42c481ad5b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:36:34 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Volume a074e629-c7cc-4553-8778-1e75f75c594b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a074e629-c7cc-4553-8778-1e75f75c594b', 'volume_size': 1} Sep 16 17:36:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:36:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:36:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2072742452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a074e629-c7cc-4553-8778-1e75f75c594b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ba19f816964c6c88c0658626157043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:36:34Z,use_quota=True,user_id='4b082b89fbba43dbb4f45910b30cb270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:36:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Creating volume a074e629-c7cc-4553-8778-1e75f75c594b {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:36:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:36:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:36:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:36:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:36:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:36:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:36:34 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:36:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a074e629-c7cc-4553-8778-1e75f75c594b 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:36:34 devstack sudo[86925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a074e629-c7cc-4553-8778-1e75f75c594b 1073741824 Sep 16 17:36:34 devstack sudo[86925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:36:35 devstack sudo[86925]: pam_unix(sudo:session): session closed for user root Sep 16 17:36:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a074e629-c7cc-4553-8778-1e75f75c594b 1073741824" returned: 0 in 0.809s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:36:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a074e629-c7cc-4553-8778-1e75f75c594b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:36:35 devstack sudo[86936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a074e629-c7cc-4553-8778-1e75f75c594b Sep 16 17:36:35 devstack sudo[86936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:36:36 devstack sudo[86936]: pam_unix(sudo:session): session closed for user root Sep 16 17:36:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a074e629-c7cc-4553-8778-1e75f75c594b" returned: 0 in 0.825s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:36:36 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:36:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:36:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98bcd985-ebf3-4535-b30c-42c481ad5b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a074e629-c7cc-4553-8778-1e75f75c594b', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:36:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72db01c-4310-4fea-a644-d81e4a4aa5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:36:36 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Volume volume-a074e629-c7cc-4553-8778-1e75f75c594b (a074e629-c7cc-4553-8778-1e75f75c594b): created successfully Sep 16 17:36:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72db01c-4310-4fea-a644-d81e4a4aa5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:36:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Flow 'volume_create_manager' (d0bbdcb6-2be2-49b9-a638-23314153adc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:36:36 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-ba9b1edc-7e60-44bc-8f6a-164b0d5338df tempest-VolumesAdminNegativeTest-188814988 None] Created volume successfully. Sep 16 17:36:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] Acquiring lock "cinder-a074e629-c7cc-4553-8778-1e75f75c594b-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:36:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] Lock "cinder-a074e629-c7cc-4553-8778-1e75f75c594b-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:36:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] Acquiring lock "cinder-quobyte-a074e629-c7cc-4553-8778-1e75f75c594b" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:36:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] Lock "cinder-quobyte-a074e629-c7cc-4553-8778-1e75f75c594b" acquired by "delete_volume" :: waited 0.031s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:36:38 devstack cinder-volume[85899]: INFO oslo.privsep.daemon [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpw1s_pe0m/privsep.sock'] Sep 16 17:36:38 devstack sudo[86969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpw1s_pe0m/privsep.sock Sep 16 17:36:38 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:36:40 devstack cinder-volume[85899]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 16 17:36:40 devstack cinder-volume[85899]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 16 17:36:40 devstack cinder-volume[85899]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 16 17:36:40 devstack cinder-volume[85899]: WARNING oslo.privsep.daemon [-] privsep log: Sep 16 17:36:40 devstack cinder-volume[85899]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 16 17:36:40 devstack cinder-volume[85899]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 16 17:36:40 devstack cinder-volume[85899]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 16 17:36:40 devstack cinder-volume[85899]: WARNING oslo.privsep.daemon [-] privsep log: Sep 16 17:36:40 devstack cinder-volume[85899]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 16 17:36:41 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root Sep 16 17:36:41 devstack cinder-volume[85899]: INFO oslo.privsep.daemon [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] Spawned new privsep daemon via rootwrap Sep 16 17:36:41 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] Accepted privsep connection to /tmp/tmpw1s_pe0m/privsep.sock {{(pid=85899) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 16 17:36:41 devstack cinder-volume[85899]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 16 17:36:41 devstack cinder-volume[85899]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 16 17:36:41 devstack cinder-volume[85899]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 16 17:36:41 devstack cinder-volume[85899]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87034 Sep 16 17:36:41 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14850d4-9317-47ce-bc6a-31d4ce2bd0ef]: (2,) {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:36:41 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb057ba1-78fe-47d0-b187-06d84cc4f9aa]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:36:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a074e629-c7cc-4553-8778-1e75f75c594b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:36:41 devstack sudo[87049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a074e629-c7cc-4553-8778-1e75f75c594b Sep 16 17:36:41 devstack sudo[87049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:36:42 devstack sudo[87049]: pam_unix(sudo:session): session closed for user root Sep 16 17:36:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a074e629-c7cc-4553-8778-1e75f75c594b" returned: 0 in 1.084s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:36:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a074e629-c7cc-4553-8778-1e75f75c594b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:36:42 devstack sudo[87071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a074e629-c7cc-4553-8778-1e75f75c594b Sep 16 17:36:42 devstack sudo[87071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:36:42 devstack sudo[87071]: pam_unix(sudo:session): session closed for user root Sep 16 17:36:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a074e629-c7cc-4553-8778-1e75f75c594b" returned: 0 in 0.377s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:36:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] Lock "cinder-quobyte-a074e629-c7cc-4553-8778-1e75f75c594b" released by "delete_volume" :: held 4.485s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:36:43 devstack cinder-volume[85899]: WARNING cinder.quota [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:36:43 devstack cinder-volume[85899]: WARNING cinder.quota [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:36:43 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] Created reservations ['fd253efd-4f20-40a3-ae49-4f9ff480c16f', 'acaf88af-8c82-4738-8829-a5c7f92a9fed', 'be03ef48-e232-4d8a-9934-551652d46827', 'd61d8438-cf13-4cb6-bcb0-0b907ad2a3ad'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:36:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:36:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:36:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:36:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:36:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:36:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:36:43 devstack sudo[87091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:36:43 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:36:43 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root Sep 16 17:36:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.693s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:36:43 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:36:43 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] Deleted volume successfully. Sep 16 17:36:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6268c64d-1cd6-4a40-ba88-830d1746a1d2 tempest-VolumesAdminNegativeTest-188814988 None] Lock "cinder-a074e629-c7cc-4553-8778-1e75f75c594b-delete_volume" released by "delete_volume" :: held 5.644s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:36:53 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:UPDATE=12,cinder:SELECT=9,cinder:INSERT=2 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:36:53 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=2 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:37:00 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:37:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Flow 'volume_create_manager' (6963a8a6-2fcf-486b-b145-54e53060e273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:37:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2c5d7b-efa2-4834-8e4a-1e5296f90789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:37:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2c5d7b-efa2-4834-8e4a-1e5296f90789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-271558227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b219be60-ed15-4884-9953-fe2a458dec4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd727ee426bc49779281498cb5253e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:37:01Z,use_quota=True,user_id='6923d5b698034d78977cb0827c393c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:37:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32728fde-bc62-4d44-ad90-cc17ba285a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:37:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32728fde-bc62-4d44-ad90-cc17ba285a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:37:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6fa55e-5c7c-426d-a1a4-3330c64f9ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:37:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6fa55e-5c7c-426d-a1a4-3330c64f9ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b219be60-ed15-4884-9953-fe2a458dec4d', 'volume_name': 'volume-b219be60-ed15-4884-9953-fe2a458dec4d', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:37:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15986b03-bf8b-4d9a-b52d-b3fbc5808472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:37:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15986b03-bf8b-4d9a-b52d-b3fbc5808472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:37:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4aeb82b-7414-4dd5-b7a4-bead03cae61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:37:00 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Volume b219be60-ed15-4884-9953-fe2a458dec4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b219be60-ed15-4884-9953-fe2a458dec4d', 'volume_size': 1} Sep 16 17:37:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:37:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:37:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-271558227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b219be60-ed15-4884-9953-fe2a458dec4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd727ee426bc49779281498cb5253e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:37:01Z,use_quota=True,user_id='6923d5b698034d78977cb0827c393c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:37:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Creating volume b219be60-ed15-4884-9953-fe2a458dec4d {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:37:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:37:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:37:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:37:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:37:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:37:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:37:00 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:37:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b219be60-ed15-4884-9953-fe2a458dec4d 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:37:00 devstack sudo[87196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b219be60-ed15-4884-9953-fe2a458dec4d 1073741824 Sep 16 17:37:00 devstack sudo[87196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:37:01 devstack sudo[87196]: pam_unix(sudo:session): session closed for user root Sep 16 17:37:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b219be60-ed15-4884-9953-fe2a458dec4d 1073741824" returned: 0 in 0.549s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:37:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b219be60-ed15-4884-9953-fe2a458dec4d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:37:01 devstack sudo[87203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b219be60-ed15-4884-9953-fe2a458dec4d Sep 16 17:37:01 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:37:01 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root Sep 16 17:37:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b219be60-ed15-4884-9953-fe2a458dec4d" returned: 0 in 0.283s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:37:01 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:37:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:37:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4aeb82b-7414-4dd5-b7a4-bead03cae61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b219be60-ed15-4884-9953-fe2a458dec4d', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:37:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64544968-568e-4577-914f-5aa95b5b1027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:37:01 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Volume volume-b219be60-ed15-4884-9953-fe2a458dec4d (b219be60-ed15-4884-9953-fe2a458dec4d): created successfully Sep 16 17:37:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64544968-568e-4577-914f-5aa95b5b1027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:37:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Flow 'volume_create_manager' (6963a8a6-2fcf-486b-b145-54e53060e273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:37:01 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-c5f44989-da36-4e5f-97d0-3e5e45b2d18b tempest-ServerActionsTestOtherA-1725898912 None] Created volume successfully. Sep 16 17:37:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:37:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:37:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:37:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:37:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:37:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:37:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:37:02 devstack sudo[87206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:37:02 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:37:02 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root Sep 16 17:37:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.296s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:37:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:37:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager._thread_info {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:37:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread count: 8 {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:37:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread info: [<_MainThread(MainThread, started 123748124422272)>, , , , , , , ] {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:37:21 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:37:21 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=3,cinder:UPDATE=5 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:37:29 devstack cinder-volume[85899]: WARNING py.warnings [req-b8c7b474-bb3e-4288-b4a0-929efba45d22 req-4fa37fb0-8508-46c7-9303-345cd88d9740 tempest-TaggedAttachmentsTest-1428445113 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 16 17:37:29 devstack cinder-volume[85899]: .first() Sep 16 17:37:29 devstack cinder-volume[85899]: Sep 16 17:37:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-b8c7b474-bb3e-4288-b4a0-929efba45d22 req-4fa37fb0-8508-46c7-9303-345cd88d9740 tempest-TaggedAttachmentsTest-1428445113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:37:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-b8c7b474-bb3e-4288-b4a0-929efba45d22 req-4fa37fb0-8508-46c7-9303-345cd88d9740 tempest-TaggedAttachmentsTest-1428445113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:37:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-b8c7b474-bb3e-4288-b4a0-929efba45d22 req-4fa37fb0-8508-46c7-9303-345cd88d9740 tempest-TaggedAttachmentsTest-1428445113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:37:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-b8c7b474-bb3e-4288-b4a0-929efba45d22 req-4fa37fb0-8508-46c7-9303-345cd88d9740 tempest-TaggedAttachmentsTest-1428445113 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7', 'name': 'volume-3fb80850-3c85-4ca1-b3a6-c5a172c8f59d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32312cac-9137-4239-a0d0-6f18fbff9137', 'enforce_multipath': True} {{(pid=85899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4920}} Sep 16 17:37:30 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-b8c7b474-bb3e-4288-b4a0-929efba45d22 req-4fa37fb0-8508-46c7-9303-345cd88d9740 tempest-TaggedAttachmentsTest-1428445113 None] attachment_update completed successfully. Sep 16 17:37:34 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:37:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Flow 'volume_create_manager' (010d2639-b8ac-49b3-b0bf-2d570a34bc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:37:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab7108a-830d-44e8-97d2-48f6b10d004c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:37:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab7108a-830d-44e8-97d2-48f6b10d004c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1345337387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e43f54-7a78-4509-8a90-e958e9e1670d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d1f3110ca54227b098fbd6b3f90b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:37:34Z,use_quota=True,user_id='6190e4370e3847a3ad32d896608f2b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:37:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9707ceaa-ee36-45e4-971a-1b04ca3bede7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:37:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9707ceaa-ee36-45e4-971a-1b04ca3bede7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:37:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab95b1c-ed6e-4edd-a5d2-026f92c10045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:37:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab95b1c-ed6e-4edd-a5d2-026f92c10045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4e43f54-7a78-4509-8a90-e958e9e1670d', 'volume_name': 'volume-f4e43f54-7a78-4509-8a90-e958e9e1670d', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:37:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8922719-a6d6-4304-bf8c-fc65bda698d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:37:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8922719-a6d6-4304-bf8c-fc65bda698d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:37:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a06c872-f046-423e-a33c-3a990454f30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:37:34 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Volume f4e43f54-7a78-4509-8a90-e958e9e1670d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4e43f54-7a78-4509-8a90-e958e9e1670d', 'volume_size': 1} Sep 16 17:37:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:37:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:37:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1345337387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e43f54-7a78-4509-8a90-e958e9e1670d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d1f3110ca54227b098fbd6b3f90b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:37:34Z,use_quota=True,user_id='6190e4370e3847a3ad32d896608f2b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:37:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Creating volume f4e43f54-7a78-4509-8a90-e958e9e1670d {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:37:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:37:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:37:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:37:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:37:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:37:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:37:34 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:37:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f4e43f54-7a78-4509-8a90-e958e9e1670d 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:37:34 devstack sudo[88057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f4e43f54-7a78-4509-8a90-e958e9e1670d 1073741824 Sep 16 17:37:34 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:37:35 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root Sep 16 17:37:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f4e43f54-7a78-4509-8a90-e958e9e1670d 1073741824" returned: 0 in 0.950s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:37:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f4e43f54-7a78-4509-8a90-e958e9e1670d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:37:35 devstack sudo[88064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f4e43f54-7a78-4509-8a90-e958e9e1670d Sep 16 17:37:35 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:37:35 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root Sep 16 17:37:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f4e43f54-7a78-4509-8a90-e958e9e1670d" returned: 0 in 0.436s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:37:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:37:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:37:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a06c872-f046-423e-a33c-3a990454f30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4e43f54-7a78-4509-8a90-e958e9e1670d', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:37:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e7bd9c-1239-4516-b7c4-a8e90c2ff0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:37:35 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Volume volume-f4e43f54-7a78-4509-8a90-e958e9e1670d (f4e43f54-7a78-4509-8a90-e958e9e1670d): created successfully Sep 16 17:37:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e7bd9c-1239-4516-b7c4-a8e90c2ff0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:37:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Flow 'volume_create_manager' (010d2639-b8ac-49b3-b0bf-2d570a34bc94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:37:35 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-37de9f73-8964-480b-a279-e2d70e9b6dae tempest-ServerRescueNegativeTestJSON-1925230273 None] Created volume successfully. Sep 16 17:37:36 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-27afdc75-5ff3-4a51-b7ab-041ad8080a06 req-f9a6d324-5544-46d5-aa88-ae57750533e9 tempest-TaggedAttachmentsTest-1428445113 None] Terminate volume connection completed successfully. Sep 16 17:37:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-27afdc75-5ff3-4a51-b7ab-041ad8080a06 req-f9a6d324-5544-46d5-aa88-ae57750533e9 tempest-TaggedAttachmentsTest-1428445113 None] Deleting attachment 32312cac-9137-4239-a0d0-6f18fbff9137. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:37:46 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:37:46 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:37:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-251d1f7b-8c0f-4320-92ab-08d3eefabd00 tempest-ServerRescueNegativeTestJSON-1925230273 None] Acquiring lock "cinder-f4e43f54-7a78-4509-8a90-e958e9e1670d-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:37:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-251d1f7b-8c0f-4320-92ab-08d3eefabd00 tempest-ServerRescueNegativeTestJSON-1925230273 None] Lock "cinder-f4e43f54-7a78-4509-8a90-e958e9e1670d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:37:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-251d1f7b-8c0f-4320-92ab-08d3eefabd00 tempest-ServerRescueNegativeTestJSON-1925230273 None] Acquiring lock "cinder-quobyte-f4e43f54-7a78-4509-8a90-e958e9e1670d" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:37:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-251d1f7b-8c0f-4320-92ab-08d3eefabd00 tempest-ServerRescueNegativeTestJSON-1925230273 None] Lock "cinder-quobyte-f4e43f54-7a78-4509-8a90-e958e9e1670d" acquired by "delete_volume" :: waited 0.040s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:37:48 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[099e3e4e-f8e9-475f-96f7-43e60c62a922]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:37:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-251d1f7b-8c0f-4320-92ab-08d3eefabd00 tempest-ServerRescueNegativeTestJSON-1925230273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f4e43f54-7a78-4509-8a90-e958e9e1670d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:37:48 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f4e43f54-7a78-4509-8a90-e958e9e1670d Sep 16 17:37:48 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:37:49 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Sep 16 17:37:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-251d1f7b-8c0f-4320-92ab-08d3eefabd00 tempest-ServerRescueNegativeTestJSON-1925230273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f4e43f54-7a78-4509-8a90-e958e9e1670d" returned: 0 in 0.949s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:37:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-251d1f7b-8c0f-4320-92ab-08d3eefabd00 tempest-ServerRescueNegativeTestJSON-1925230273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f4e43f54-7a78-4509-8a90-e958e9e1670d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:37:49 devstack sudo[88279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f4e43f54-7a78-4509-8a90-e958e9e1670d Sep 16 17:37:49 devstack sudo[88279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:37:49 devstack sudo[88279]: pam_unix(sudo:session): session closed for user root Sep 16 17:37:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-251d1f7b-8c0f-4320-92ab-08d3eefabd00 tempest-ServerRescueNegativeTestJSON-1925230273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f4e43f54-7a78-4509-8a90-e958e9e1670d" returned: 0 in 0.413s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:37:49 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-251d1f7b-8c0f-4320-92ab-08d3eefabd00 tempest-ServerRescueNegativeTestJSON-1925230273 None] Lock "cinder-quobyte-f4e43f54-7a78-4509-8a90-e958e9e1670d" released by "delete_volume" :: held 1.485s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:37:50 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-251d1f7b-8c0f-4320-92ab-08d3eefabd00 tempest-ServerRescueNegativeTestJSON-1925230273 None] Created reservations ['98bba0e5-35b0-40e0-b2f7-9817a265936d', 'd5a67a0e-7a7d-4e65-9918-566e504c325a', '95b5821a-5f58-4b6d-81d6-6683a8f1618f', 'a63d3a54-1a4f-4c4a-b9db-df0db8d58303'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:37:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-251d1f7b-8c0f-4320-92ab-08d3eefabd00 tempest-ServerRescueNegativeTestJSON-1925230273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:37:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-251d1f7b-8c0f-4320-92ab-08d3eefabd00 tempest-ServerRescueNegativeTestJSON-1925230273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:37:50 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-251d1f7b-8c0f-4320-92ab-08d3eefabd00 tempest-ServerRescueNegativeTestJSON-1925230273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:37:50 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-251d1f7b-8c0f-4320-92ab-08d3eefabd00 tempest-ServerRescueNegativeTestJSON-1925230273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:37:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-251d1f7b-8c0f-4320-92ab-08d3eefabd00 tempest-ServerRescueNegativeTestJSON-1925230273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:37:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-251d1f7b-8c0f-4320-92ab-08d3eefabd00 tempest-ServerRescueNegativeTestJSON-1925230273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:37:50 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:37:50 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:37:50 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Sep 16 17:37:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-251d1f7b-8c0f-4320-92ab-08d3eefabd00 tempest-ServerRescueNegativeTestJSON-1925230273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.324s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:37:50 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-251d1f7b-8c0f-4320-92ab-08d3eefabd00 tempest-ServerRescueNegativeTestJSON-1925230273 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:37:50 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-251d1f7b-8c0f-4320-92ab-08d3eefabd00 tempest-ServerRescueNegativeTestJSON-1925230273 None] Deleted volume successfully. Sep 16 17:37:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-251d1f7b-8c0f-4320-92ab-08d3eefabd00 tempest-ServerRescueNegativeTestJSON-1925230273 None] Lock "cinder-f4e43f54-7a78-4509-8a90-e958e9e1670d-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:37:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-66878a2f-3c10-41da-b9c4-d150b6cda41b req-d07c804b-0ced-45a5-a3dd-85e678cb5ee7 tempest-ServerActionsTestOtherA-1725898912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:37:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-66878a2f-3c10-41da-b9c4-d150b6cda41b req-d07c804b-0ced-45a5-a3dd-85e678cb5ee7 tempest-ServerActionsTestOtherA-1725898912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:37:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-66878a2f-3c10-41da-b9c4-d150b6cda41b req-d07c804b-0ced-45a5-a3dd-85e678cb5ee7 tempest-ServerActionsTestOtherA-1725898912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:37:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-66878a2f-3c10-41da-b9c4-d150b6cda41b req-d07c804b-0ced-45a5-a3dd-85e678cb5ee7 tempest-ServerActionsTestOtherA-1725898912 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7', 'name': 'volume-b219be60-ed15-4884-9953-fe2a458dec4d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e54a507d-65b2-47e6-8999-8b222b2a627b', 'enforce_multipath': True} {{(pid=85899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4920}} Sep 16 17:37:54 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-66878a2f-3c10-41da-b9c4-d150b6cda41b req-d07c804b-0ced-45a5-a3dd-85e678cb5ee7 tempest-ServerActionsTestOtherA-1725898912 None] attachment_update completed successfully. Sep 16 17:37:55 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8508eba4-7dea-4e3d-b3ef-83c2efa59f98 tempest-TaggedAttachmentsTest-1428445113 None] Acquiring lock "cinder-3fb80850-3c85-4ca1-b3a6-c5a172c8f59d-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:37:55 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8508eba4-7dea-4e3d-b3ef-83c2efa59f98 tempest-TaggedAttachmentsTest-1428445113 None] Lock "cinder-3fb80850-3c85-4ca1-b3a6-c5a172c8f59d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:37:55 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8508eba4-7dea-4e3d-b3ef-83c2efa59f98 tempest-TaggedAttachmentsTest-1428445113 None] Acquiring lock "cinder-quobyte-3fb80850-3c85-4ca1-b3a6-c5a172c8f59d" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:37:55 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8508eba4-7dea-4e3d-b3ef-83c2efa59f98 tempest-TaggedAttachmentsTest-1428445113 None] Lock "cinder-quobyte-3fb80850-3c85-4ca1-b3a6-c5a172c8f59d" acquired by "delete_volume" :: waited 0.035s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:37:55 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a257200e-75fe-4dce-8d9b-6aff0ea8cbb3]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:37:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8508eba4-7dea-4e3d-b3ef-83c2efa59f98 tempest-TaggedAttachmentsTest-1428445113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3fb80850-3c85-4ca1-b3a6-c5a172c8f59d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:37:56 devstack sudo[88761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3fb80850-3c85-4ca1-b3a6-c5a172c8f59d Sep 16 17:37:56 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:37:56 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root Sep 16 17:37:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8508eba4-7dea-4e3d-b3ef-83c2efa59f98 tempest-TaggedAttachmentsTest-1428445113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3fb80850-3c85-4ca1-b3a6-c5a172c8f59d" returned: 0 in 0.895s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:37:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8508eba4-7dea-4e3d-b3ef-83c2efa59f98 tempest-TaggedAttachmentsTest-1428445113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3fb80850-3c85-4ca1-b3a6-c5a172c8f59d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:37:56 devstack sudo[88804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3fb80850-3c85-4ca1-b3a6-c5a172c8f59d Sep 16 17:37:56 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:37:57 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root Sep 16 17:37:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8508eba4-7dea-4e3d-b3ef-83c2efa59f98 tempest-TaggedAttachmentsTest-1428445113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3fb80850-3c85-4ca1-b3a6-c5a172c8f59d" returned: 0 in 0.553s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:37:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8508eba4-7dea-4e3d-b3ef-83c2efa59f98 tempest-TaggedAttachmentsTest-1428445113 None] Lock "cinder-quobyte-3fb80850-3c85-4ca1-b3a6-c5a172c8f59d" released by "delete_volume" :: held 1.578s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:37:57 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-8508eba4-7dea-4e3d-b3ef-83c2efa59f98 tempest-TaggedAttachmentsTest-1428445113 None] Created reservations ['95574ee3-c623-4ecb-9d06-1620315fa8fb', 'cbe1a701-df6f-4672-a1b5-efa4c52795b5', 'c715b7ca-8850-4a9f-a5fb-9f4dfa124491', 'cd95edeb-2c5f-4035-8a31-dde433917668'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:37:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8508eba4-7dea-4e3d-b3ef-83c2efa59f98 tempest-TaggedAttachmentsTest-1428445113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:37:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8508eba4-7dea-4e3d-b3ef-83c2efa59f98 tempest-TaggedAttachmentsTest-1428445113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:37:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8508eba4-7dea-4e3d-b3ef-83c2efa59f98 tempest-TaggedAttachmentsTest-1428445113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:37:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8508eba4-7dea-4e3d-b3ef-83c2efa59f98 tempest-TaggedAttachmentsTest-1428445113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:37:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8508eba4-7dea-4e3d-b3ef-83c2efa59f98 tempest-TaggedAttachmentsTest-1428445113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:37:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8508eba4-7dea-4e3d-b3ef-83c2efa59f98 tempest-TaggedAttachmentsTest-1428445113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:37:57 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:37:57 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:37:58 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Sep 16 17:37:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8508eba4-7dea-4e3d-b3ef-83c2efa59f98 tempest-TaggedAttachmentsTest-1428445113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.571s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:37:58 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-8508eba4-7dea-4e3d-b3ef-83c2efa59f98 tempest-TaggedAttachmentsTest-1428445113 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:37:58 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-8508eba4-7dea-4e3d-b3ef-83c2efa59f98 tempest-TaggedAttachmentsTest-1428445113 None] Deleted volume successfully. Sep 16 17:37:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8508eba4-7dea-4e3d-b3ef-83c2efa59f98 tempest-TaggedAttachmentsTest-1428445113 None] Lock "cinder-3fb80850-3c85-4ca1-b3a6-c5a172c8f59d-delete_volume" released by "delete_volume" :: held 2.776s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:38:01 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-f11ff98f-6116-4489-b2cf-6d1f0154346b req-7d852e61-51d5-48c9-bd1a-11121d32921b tempest-ServerActionsTestOtherA-1725898912 None] Terminate volume connection completed successfully. Sep 16 17:38:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-f11ff98f-6116-4489-b2cf-6d1f0154346b req-7d852e61-51d5-48c9-bd1a-11121d32921b tempest-ServerActionsTestOtherA-1725898912 None] Deleting attachment e54a507d-65b2-47e6-8999-8b222b2a627b. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:38:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:38:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:38:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:38:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:38:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:38:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:38:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:02 devstack sudo[88913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:38:02 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:02 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.636s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-f11ff98f-6116-4489-b2cf-6d1f0154346b req-4f22ef49-cd03-4b5b-8a58-0e4b94545ac6 tempest-ServerActionsTestOtherA-1725898912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-f11ff98f-6116-4489-b2cf-6d1f0154346b req-4f22ef49-cd03-4b5b-8a58-0e4b94545ac6 tempest-ServerActionsTestOtherA-1725898912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-f11ff98f-6116-4489-b2cf-6d1f0154346b req-4f22ef49-cd03-4b5b-8a58-0e4b94545ac6 tempest-ServerActionsTestOtherA-1725898912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-f11ff98f-6116-4489-b2cf-6d1f0154346b req-4f22ef49-cd03-4b5b-8a58-0e4b94545ac6 tempest-ServerActionsTestOtherA-1725898912 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7', 'name': 'volume-b219be60-ed15-4884-9953-fe2a458dec4d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b185858-4874-4d38-bc1a-07cc7d3f84d9', 'enforce_multipath': True} {{(pid=85899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4920}} Sep 16 17:38:03 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-f11ff98f-6116-4489-b2cf-6d1f0154346b req-4f22ef49-cd03-4b5b-8a58-0e4b94545ac6 tempest-ServerActionsTestOtherA-1725898912 None] attachment_update completed successfully. Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Flow 'volume_create_manager' (b61e8c1d-9779-4855-8ce7-3678677aa76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (080f92c3-af0b-4b12-8a53-b113aa8212ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (080f92c3-af0b-4b12-8a53-b113aa8212ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-324305606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1203fc4f-308c-4042-aad4-33c71850e7e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffcb51cfb90d4f988af8dd94d9d7e78e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:38:03Z,use_quota=True,user_id='10effb92d1c14d8bb94eced86eb06b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a4866f-355c-4a62-a9b0-0e14261cb99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a4866f-355c-4a62-a9b0-0e14261cb99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b396e9-f256-453e-b5ed-3a76db8c772a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b396e9-f256-453e-b5ed-3a76db8c772a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1203fc4f-308c-4042-aad4-33c71850e7e0', 'volume_name': 'volume-1203fc4f-308c-4042-aad4-33c71850e7e0', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c019284d-00c6-429c-aaa3-dd56129a864b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c019284d-00c6-429c-aaa3-dd56129a864b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39347bef-e0b8-4d57-9257-d3d083b8c017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:38:03 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Volume 1203fc4f-308c-4042-aad4-33c71850e7e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1203fc4f-308c-4042-aad4-33c71850e7e0', 'volume_size': 1} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-324305606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1203fc4f-308c-4042-aad4-33c71850e7e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffcb51cfb90d4f988af8dd94d9d7e78e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:38:03Z,use_quota=True,user_id='10effb92d1c14d8bb94eced86eb06b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Creating volume 1203fc4f-308c-4042-aad4-33c71850e7e0 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:38:03 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:38:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1203fc4f-308c-4042-aad4-33c71850e7e0 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:03 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1203fc4f-308c-4042-aad4-33c71850e7e0 1073741824 Sep 16 17:38:03 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:04 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1203fc4f-308c-4042-aad4-33c71850e7e0 1073741824" returned: 0 in 0.701s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1203fc4f-308c-4042-aad4-33c71850e7e0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:04 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1203fc4f-308c-4042-aad4-33c71850e7e0 Sep 16 17:38:04 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:05 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1203fc4f-308c-4042-aad4-33c71850e7e0" returned: 0 in 0.721s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:05 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:38:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:38:05 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39347bef-e0b8-4d57-9257-d3d083b8c017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1203fc4f-308c-4042-aad4-33c71850e7e0', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:38:05 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7837058b-f3d6-4f6f-978b-f527c0e624a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:38:05 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Volume volume-1203fc4f-308c-4042-aad4-33c71850e7e0 (1203fc4f-308c-4042-aad4-33c71850e7e0): created successfully Sep 16 17:38:05 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7837058b-f3d6-4f6f-978b-f527c0e624a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:38:05 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Flow 'volume_create_manager' (b61e8c1d-9779-4855-8ce7-3678677aa76a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:38:05 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-c468be87-7ae9-4681-9a7f-9094aaad71b1 tempest-DeleteServersTestJSON-681716667 None] Created volume successfully. Sep 16 17:38:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-b4496380-4433-4d47-9522-e107b89b33d0 req-0602f727-3b0e-48c4-9b6e-54190db17275 tempest-DeleteServersTestJSON-681716667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:38:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-b4496380-4433-4d47-9522-e107b89b33d0 req-0602f727-3b0e-48c4-9b6e-54190db17275 tempest-DeleteServersTestJSON-681716667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:38:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-b4496380-4433-4d47-9522-e107b89b33d0 req-0602f727-3b0e-48c4-9b6e-54190db17275 tempest-DeleteServersTestJSON-681716667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:38:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-b4496380-4433-4d47-9522-e107b89b33d0 req-0602f727-3b0e-48c4-9b6e-54190db17275 tempest-DeleteServersTestJSON-681716667 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7', 'name': 'volume-1203fc4f-308c-4042-aad4-33c71850e7e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f42a5b71-665b-4824-b010-02527a0a7fe2', 'enforce_multipath': True} {{(pid=85899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4920}} Sep 16 17:38:07 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-b4496380-4433-4d47-9522-e107b89b33d0 req-0602f727-3b0e-48c4-9b6e-54190db17275 tempest-DeleteServersTestJSON-681716667 None] attachment_update completed successfully. Sep 16 17:38:12 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-34faf559-b6fb-4303-9474-0acd102387eb req-332f9a0b-7b93-4300-8df3-9dd546eeb49d tempest-DeleteServersTestJSON-681716667 None] Terminate volume connection completed successfully. Sep 16 17:38:12 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-34faf559-b6fb-4303-9474-0acd102387eb req-332f9a0b-7b93-4300-8df3-9dd546eeb49d tempest-DeleteServersTestJSON-681716667 None] Deleting attachment f42a5b71-665b-4824-b010-02527a0a7fe2. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:38:14 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7c568bb8-ee3b-4d6e-b5b4-c2bbcda0d94d tempest-DeleteServersTestJSON-681716667 None] Acquiring lock "cinder-1203fc4f-308c-4042-aad4-33c71850e7e0-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:38:14 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7c568bb8-ee3b-4d6e-b5b4-c2bbcda0d94d tempest-DeleteServersTestJSON-681716667 None] Lock "cinder-1203fc4f-308c-4042-aad4-33c71850e7e0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:38:14 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7c568bb8-ee3b-4d6e-b5b4-c2bbcda0d94d tempest-DeleteServersTestJSON-681716667 None] Acquiring lock "cinder-quobyte-1203fc4f-308c-4042-aad4-33c71850e7e0" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:38:14 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7c568bb8-ee3b-4d6e-b5b4-c2bbcda0d94d tempest-DeleteServersTestJSON-681716667 None] Lock "cinder-quobyte-1203fc4f-308c-4042-aad4-33c71850e7e0" acquired by "delete_volume" :: waited 0.031s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:38:14 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a48dea2-69ee-4a7f-a4b8-cd35de4454fe]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:38:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7c568bb8-ee3b-4d6e-b5b4-c2bbcda0d94d tempest-DeleteServersTestJSON-681716667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1203fc4f-308c-4042-aad4-33c71850e7e0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:14 devstack sudo[89489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1203fc4f-308c-4042-aad4-33c71850e7e0 Sep 16 17:38:14 devstack sudo[89489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:15 devstack sudo[89489]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7c568bb8-ee3b-4d6e-b5b4-c2bbcda0d94d tempest-DeleteServersTestJSON-681716667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1203fc4f-308c-4042-aad4-33c71850e7e0" returned: 0 in 0.581s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7c568bb8-ee3b-4d6e-b5b4-c2bbcda0d94d tempest-DeleteServersTestJSON-681716667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1203fc4f-308c-4042-aad4-33c71850e7e0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:15 devstack sudo[89494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1203fc4f-308c-4042-aad4-33c71850e7e0 Sep 16 17:38:15 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:15 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7c568bb8-ee3b-4d6e-b5b4-c2bbcda0d94d tempest-DeleteServersTestJSON-681716667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1203fc4f-308c-4042-aad4-33c71850e7e0" returned: 0 in 0.314s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:15 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7c568bb8-ee3b-4d6e-b5b4-c2bbcda0d94d tempest-DeleteServersTestJSON-681716667 None] Lock "cinder-quobyte-1203fc4f-308c-4042-aad4-33c71850e7e0" released by "delete_volume" :: held 0.974s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:38:15 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-7c568bb8-ee3b-4d6e-b5b4-c2bbcda0d94d tempest-DeleteServersTestJSON-681716667 None] Created reservations ['779666c2-80f7-45bb-8807-868206d8f3e2', 'e048fb7f-b0fc-4835-8f9f-0617208b2c74', '36305198-6f87-4bd9-975a-7efd8cb03461', '96a504ab-3078-4ca3-a6c8-020a844b0319'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:38:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7c568bb8-ee3b-4d6e-b5b4-c2bbcda0d94d tempest-DeleteServersTestJSON-681716667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:38:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7c568bb8-ee3b-4d6e-b5b4-c2bbcda0d94d tempest-DeleteServersTestJSON-681716667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:38:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7c568bb8-ee3b-4d6e-b5b4-c2bbcda0d94d tempest-DeleteServersTestJSON-681716667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:38:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7c568bb8-ee3b-4d6e-b5b4-c2bbcda0d94d tempest-DeleteServersTestJSON-681716667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:38:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7c568bb8-ee3b-4d6e-b5b4-c2bbcda0d94d tempest-DeleteServersTestJSON-681716667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:38:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7c568bb8-ee3b-4d6e-b5b4-c2bbcda0d94d tempest-DeleteServersTestJSON-681716667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:15 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:38:15 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:16 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7c568bb8-ee3b-4d6e-b5b4-c2bbcda0d94d tempest-DeleteServersTestJSON-681716667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.480s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:16 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-7c568bb8-ee3b-4d6e-b5b4-c2bbcda0d94d tempest-DeleteServersTestJSON-681716667 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:38:16 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-7c568bb8-ee3b-4d6e-b5b4-c2bbcda0d94d tempest-DeleteServersTestJSON-681716667 None] Deleted volume successfully. Sep 16 17:38:16 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7c568bb8-ee3b-4d6e-b5b4-c2bbcda0d94d tempest-DeleteServersTestJSON-681716667 None] Lock "cinder-1203fc4f-308c-4042-aad4-33c71850e7e0-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:38:25 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:UPDATE=34,cinder:SELECT=35,cinder:INSERT=9 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:38:26 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=42,cinder:INSERT=4,cinder:UPDATE=29,cinder:DELETE=4 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:38:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e0b5e215-e657-4463-b19f-5eb3587c6111 tempest-BackendsCapabilitiesAdminTestsJSON-1806613971 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8084831237793, 'free_capacity_gb': 1775.8084831237793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85899) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4826}} Sep 16 17:38:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bc5f5fbd-5cc3-49f7-8a25-99121da7dee4 tempest-BackendsCapabilitiesAdminTestsJSON-1806613971 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8084831237793, 'free_capacity_gb': 1775.8084831237793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85899) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4826}} Sep 16 17:38:34 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-01c463ad-6cbe-46c1-8ec5-7ed4da402514 req-64bf7dd2-d2bb-44ce-80e6-cd6626471950 tempest-ServerActionsTestOtherA-1725898912 None] Terminate volume connection completed successfully. Sep 16 17:38:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-01c463ad-6cbe-46c1-8ec5-7ed4da402514 req-64bf7dd2-d2bb-44ce-80e6-cd6626471950 tempest-ServerActionsTestOtherA-1725898912 None] Deleting attachment 6b185858-4874-4d38-bc1a-07cc7d3f84d9. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:38:40 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-63aa8e57-573a-423d-a09b-020b9c124fe4 tempest-GroupSnapshotsV319Test-539841923 None] Group tempest-GroupSnapshotsV319Test-Group-425588245: creating Sep 16 17:38:41 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-63aa8e57-573a-423d-a09b-020b9c124fe4 tempest-GroupSnapshotsV319Test-539841923 None] Group tempest-GroupSnapshotsV319Test-Group-425588245: created successfully Sep 16 17:38:41 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-63aa8e57-573a-423d-a09b-020b9c124fe4 tempest-GroupSnapshotsV319Test-539841923 None] Create group completed successfully. Sep 16 17:38:43 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:38:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Flow 'volume_create_manager' (92cc7d51-8ff7-4510-aa24-afc1a6731b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:38:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffba8c12-3826-4590-b73e-22b191480844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:38:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffba8c12-3826-4590-b73e-22b191480844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-722645717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28ed0f69-91ec-4d84-aecc-fa101099ed2f,host='devstack@QuobyteHD#QuobyteHD',id=83ca28b6-e934-4528-9bae-32d5dea183af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0dd42e59f04a05a50915015aa32c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:38:43Z,use_quota=True,user_id='b02cc0a0c0564a7db14633da6c3bf0b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9118b642-0750-476a-9c96-84661da2f70d),volume_type_id=9118b642-0750-476a-9c96-84661da2f70d)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:38:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfdae3f1-5405-4782-a918-23c4c4d96e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:38:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfdae3f1-5405-4782-a918-23c4c4d96e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:38:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f77badd-7839-44cf-b50d-7a891ae96a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:38:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f77badd-7839-44cf-b50d-7a891ae96a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83ca28b6-e934-4528-9bae-32d5dea183af', 'volume_name': 'volume-83ca28b6-e934-4528-9bae-32d5dea183af', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:38:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e396922-e358-4715-9d7f-986b63a76ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:38:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e396922-e358-4715-9d7f-986b63a76ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:38:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38b6286-6aee-436e-83b5-a00fb25bc3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:38:43 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Volume 83ca28b6-e934-4528-9bae-32d5dea183af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83ca28b6-e934-4528-9bae-32d5dea183af', 'volume_size': 1} Sep 16 17:38:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:38:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:38:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=28ed0f69-91ec-4d84-aecc-fa101099ed2f,created_at=2026-09-16T15:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-722645717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28ed0f69-91ec-4d84-aecc-fa101099ed2f,host='devstack@QuobyteHD#QuobyteHD',id=83ca28b6-e934-4528-9bae-32d5dea183af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0dd42e59f04a05a50915015aa32c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:38:43Z,use_quota=True,user_id='b02cc0a0c0564a7db14633da6c3bf0b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9118b642-0750-476a-9c96-84661da2f70d),volume_type_id=9118b642-0750-476a-9c96-84661da2f70d)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:38:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Creating volume 83ca28b6-e934-4528-9bae-32d5dea183af {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:38:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:38:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:38:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:38:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:38:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:38:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:38:43 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:38:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:43 devstack sudo[89722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af 1073741824 Sep 16 17:38:43 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:44 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af 1073741824" returned: 0 in 0.828s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:44 devstack sudo[89728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af Sep 16 17:38:44 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:45 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af" returned: 0 in 0.404s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:38:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:38:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38b6286-6aee-436e-83b5-a00fb25bc3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83ca28b6-e934-4528-9bae-32d5dea183af', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:38:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a5cdc7-f8dc-4c50-95b2-454b1f4221fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:38:45 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Volume volume-83ca28b6-e934-4528-9bae-32d5dea183af (83ca28b6-e934-4528-9bae-32d5dea183af): created successfully Sep 16 17:38:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a5cdc7-f8dc-4c50-95b2-454b1f4221fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:38:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Flow 'volume_create_manager' (92cc7d51-8ff7-4510-aa24-afc1a6731b81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:38:45 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-adb405d2-011b-401f-b822-87e356de1669 tempest-GroupSnapshotsV319Test-539841923 None] Created volume successfully. Sep 16 17:38:46 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-6b90b2b1-03fe-4132-aacd-019d5fcda4d1 tempest-GroupSnapshotsV319Test-539841923 None] GroupSnapshot f5d2b67c-b1c5-49ba-9b48-4f18b190eb7e: creating. Sep 16 17:38:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6b90b2b1-03fe-4132-aacd-019d5fcda4d1 tempest-GroupSnapshotsV319Test-539841923 None] Group snapshot f5d2b67c-b1c5-49ba-9b48-4f18b190eb7e: creating. {{(pid=85899) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4171}} Sep 16 17:38:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6b90b2b1-03fe-4132-aacd-019d5fcda4d1 tempest-GroupSnapshotsV319Test-539841923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:38:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6b90b2b1-03fe-4132-aacd-019d5fcda4d1 tempest-GroupSnapshotsV319Test-539841923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:38:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-6b90b2b1-03fe-4132-aacd-019d5fcda4d1 tempest-GroupSnapshotsV319Test-539841923 None] Creating offline snapshot f60b3b0f-51d9-4627-b9d4-ece608fb430b of volume 83ca28b6-e934-4528-9bae-32d5dea183af {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:38:47 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb0e41c-431b-4390-85f8-4bb62b6f297d]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:38:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6b90b2b1-03fe-4132-aacd-019d5fcda4d1 tempest-GroupSnapshotsV319Test-539841923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:47 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af Sep 16 17:38:47 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:47 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:38:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Flow 'volume_create_manager' (fe83dedf-1812-4220-9ce4-d570eb1fa245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:38:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fddf3ad-a2fa-40b8-ac08-97528b562846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:38:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fddf3ad-a2fa-40b8-ac08-97528b562846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-67519045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55da318f-2c82-47ff-bc72-9f94452da684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd727ee426bc49779281498cb5253e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:38:47Z,use_quota=True,user_id='6923d5b698034d78977cb0827c393c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:38:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e38171-ebbd-4965-8253-aa8a2602e98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:38:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e38171-ebbd-4965-8253-aa8a2602e98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:38:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fbf25e5-7c77-435f-b498-0356f50d6b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:38:47 devstack cinder-volume[85899]: DEBUG cinder.image.glance [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Creating Keystone auth plugin from conf {{(pid=85899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 17:38:47 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6b90b2b1-03fe-4132-aacd-019d5fcda4d1 tempest-GroupSnapshotsV319Test-539841923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af" returned: 0 in 0.593s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6b90b2b1-03fe-4132-aacd-019d5fcda4d1 tempest-GroupSnapshotsV319Test-539841923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.f60b3b0f-51d9-4627-b9d4-ece608fb430b 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:47 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.f60b3b0f-51d9-4627-b9d4-ece608fb430b 1G Sep 16 17:38:47 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:48 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6b90b2b1-03fe-4132-aacd-019d5fcda4d1 tempest-GroupSnapshotsV319Test-539841923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.f60b3b0f-51d9-4627-b9d4-ece608fb430b 1G" returned: 0 in 0.841s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6b90b2b1-03fe-4132-aacd-019d5fcda4d1 tempest-GroupSnapshotsV319Test-539841923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ca28b6-e934-4528-9bae-32d5dea183af -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.f60b3b0f-51d9-4627-b9d4-ece608fb430b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:48 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ca28b6-e934-4528-9bae-32d5dea183af -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.f60b3b0f-51d9-4627-b9d4-ece608fb430b Sep 16 17:38:48 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fbf25e5-7c77-435f-b498-0356f50d6b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '55da318f-2c82-47ff-bc72-9f94452da684', 'volume_name': 'volume-55da318f-2c82-47ff-bc72-9f94452da684', 'volume_size': 1, 'image_id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '124a9fc6f0b448c1afab7b2b666efe75', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'created_at': datetime.datetime(2026, 9, 16, 15, 30, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 30, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81ac455d-f592-4ef7-8c27-23e4054a633b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:38:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29c98d5-c4bd-459e-85c3-d83420891a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:38:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29c98d5-c4bd-459e-85c3-d83420891a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:38:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b57a9e-0b43-4766-877c-bcbdcdb9c7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:38:48 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Volume 55da318f-2c82-47ff-bc72-9f94452da684: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-55da318f-2c82-47ff-bc72-9f94452da684', 'volume_size': 1, 'image_id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '124a9fc6f0b448c1afab7b2b666efe75', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'created_at': datetime.datetime(2026, 9, 16, 15, 30, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 30, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81ac455d-f592-4ef7-8c27-23e4054a633b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 17:38:48 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Trying to clone 55da318f-2c82-47ff-bc72-9f94452da684 from image 81ac455d-f592-4ef7-8c27-23e4054a633b at location (None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}]). {{(pid=85899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 17:38:49 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6b90b2b1-03fe-4132-aacd-019d5fcda4d1 tempest-GroupSnapshotsV319Test-539841923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ca28b6-e934-4528-9bae-32d5dea183af -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.f60b3b0f-51d9-4627-b9d4-ece608fb430b" returned: 0 in 0.545s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:49 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-6b90b2b1-03fe-4132-aacd-019d5fcda4d1 tempest-GroupSnapshotsV319Test-539841923 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.f60b3b0f-51d9-4627-b9d4-ece608fb430b is being set with open permissions: ugo+rw: NotImplementedError Sep 16 17:38:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6b90b2b1-03fe-4132-aacd-019d5fcda4d1 tempest-GroupSnapshotsV319Test-539841923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.f60b3b0f-51d9-4627-b9d4-ece608fb430b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:49 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.f60b3b0f-51d9-4627-b9d4-ece608fb430b Sep 16 17:38:49 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:49 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_bdvj7mxydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 16 17:38:49 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Image download 20.69 MB at 20.69 MB/s Sep 16 17:38:49 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6b90b2b1-03fe-4132-aacd-019d5fcda4d1 tempest-GroupSnapshotsV319Test-539841923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.f60b3b0f-51d9-4627-b9d4-ece608fb430b" returned: 0 in 0.564s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6b90b2b1-03fe-4132-aacd-019d5fcda4d1 tempest-GroupSnapshotsV319Test-539841923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:49 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.info Sep 16 17:38:49 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0a9baa-a7e6-428b-8458-9e84a324fac6]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:38:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_bdvj7mxydevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:49 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:50 devstack sudo[89795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_bdvj7mxydevstack@QuobyteHD Sep 16 17:38:50 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:50 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6b90b2b1-03fe-4132-aacd-019d5fcda4d1 tempest-GroupSnapshotsV319Test-539841923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.info" returned: 0 in 0.501s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:50 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-6b90b2b1-03fe-4132-aacd-019d5fcda4d1 tempest-GroupSnapshotsV319Test-539841923 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.info is being set with open permissions: ugo+rw: NotImplementedError Sep 16 17:38:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6b90b2b1-03fe-4132-aacd-019d5fcda4d1 tempest-GroupSnapshotsV319Test-539841923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:50 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.info Sep 16 17:38:50 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:50 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:50 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6b90b2b1-03fe-4132-aacd-019d5fcda4d1 tempest-GroupSnapshotsV319Test-539841923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.info" returned: 0 in 0.481s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6b90b2b1-03fe-4132-aacd-019d5fcda4d1 tempest-GroupSnapshotsV319Test-539841923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.714s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:38:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_bdvj7mxydevstack@QuobyteHD" returned: 0 in 0.996s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:50 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Temporary image 81ac455d-f592-4ef7-8c27-23e4054a633b is fetched for user 6923d5b698034d78977cb0827c393c69. {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 16 17:38:50 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee80d56-1580-4912-90b2-762b421f6c47]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:38:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_bdvj7mxydevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:51 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-6b90b2b1-03fe-4132-aacd-019d5fcda4d1 tempest-GroupSnapshotsV319Test-539841923 None] group_snapshot f5d2b67c-b1c5-49ba-9b48-4f18b190eb7e: created successfully Sep 16 17:38:51 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_bdvj7mxydevstack@QuobyteHD Sep 16 17:38:51 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:51 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_bdvj7mxydevstack@QuobyteHD" returned: 0 in 0.621s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:38:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:38:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-67519045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55da318f-2c82-47ff-bc72-9f94452da684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd727ee426bc49779281498cb5253e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:38:47Z,use_quota=True,user_id='6923d5b698034d78977cb0827c393c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:38:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Creating volume 55da318f-2c82-47ff-bc72-9f94452da684 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:38:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:38:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:38:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:38:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:38:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:38:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:38:51 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:38:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-55da318f-2c82-47ff-bc72-9f94452da684 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:51 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-55da318f-2c82-47ff-bc72-9f94452da684 1073741824 Sep 16 17:38:51 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:52 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-d9ce42bb-800b-4423-959d-dbaf88c0fe1c tempest-GroupSnapshotsV319Test-539841923 None] group_snapshot f5d2b67c-b1c5-49ba-9b48-4f18b190eb7e: deleting Sep 16 17:38:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d9ce42bb-800b-4423-959d-dbaf88c0fe1c tempest-GroupSnapshotsV319Test-539841923 None] group_snapshot f5d2b67c-b1c5-49ba-9b48-4f18b190eb7e: deleting {{(pid=85899) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4346}} Sep 16 17:38:52 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d9ce42bb-800b-4423-959d-dbaf88c0fe1c tempest-GroupSnapshotsV319Test-539841923 None] Acquiring lock "cinder-quobyte-83ca28b6-e934-4528-9bae-32d5dea183af" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:38:52 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d9ce42bb-800b-4423-959d-dbaf88c0fe1c tempest-GroupSnapshotsV319Test-539841923 None] Lock "cinder-quobyte-83ca28b6-e934-4528-9bae-32d5dea183af" acquired by "delete_snapshot" :: waited 0.038s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:38:52 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d9ce42bb-800b-4423-959d-dbaf88c0fe1c tempest-GroupSnapshotsV319Test-539841923 None] Acquiring lock "cinder-quobyte-f60b3b0f-51d9-4627-b9d4-ece608fb430b" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:38:52 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d9ce42bb-800b-4423-959d-dbaf88c0fe1c tempest-GroupSnapshotsV319Test-539841923 None] Lock "cinder-quobyte-f60b3b0f-51d9-4627-b9d4-ece608fb430b" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:38:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-d9ce42bb-800b-4423-959d-dbaf88c0fe1c tempest-GroupSnapshotsV319Test-539841923 None] Deleting offline snapshot f60b3b0f-51d9-4627-b9d4-ece608fb430b of volume 83ca28b6-e934-4528-9bae-32d5dea183af {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:38:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-d9ce42bb-800b-4423-959d-dbaf88c0fe1c tempest-GroupSnapshotsV319Test-539841923 None] snapshot_file for this snap is: volume-83ca28b6-e934-4528-9bae-32d5dea183af.f60b3b0f-51d9-4627-b9d4-ece608fb430b {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:38:52 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-55da318f-2c82-47ff-bc72-9f94452da684 1073741824" returned: 0 in 0.704s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:52 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[045d38e6-6cd6-4822-ac36-8ea9a589d314]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:38:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d9ce42bb-800b-4423-959d-dbaf88c0fe1c tempest-GroupSnapshotsV319Test-539841923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.f60b3b0f-51d9-4627-b9d4-ece608fb430b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-55da318f-2c82-47ff-bc72-9f94452da684 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:52 devstack sudo[89845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-55da318f-2c82-47ff-bc72-9f94452da684 Sep 16 17:38:52 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:52 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.f60b3b0f-51d9-4627-b9d4-ece608fb430b Sep 16 17:38:52 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:52 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-55da318f-2c82-47ff-bc72-9f94452da684" returned: 0 in 0.479s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:38:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:38:52 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Attempting download of 81ac455d-f592-4ef7-8c27-23e4054a633b ((None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}])) to volume 55da318f-2c82-47ff-bc72-9f94452da684. {{(pid=85899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 17:38:53 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d9ce42bb-800b-4423-959d-dbaf88c0fe1c tempest-GroupSnapshotsV319Test-539841923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.f60b3b0f-51d9-4627-b9d4-ece608fb430b" returned: 0 in 0.674s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-d9ce42bb-800b-4423-959d-dbaf88c0fe1c tempest-GroupSnapshotsV319Test-539841923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83ca28b6-e934-4528-9bae-32d5dea183af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:38:53 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cb4f89-6c4a-4504-8b8f-bb1c2e900ba3]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:38:53 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[057a60f9-92c3-44e9-a48b-82588c18cb38]: (4, 'raw') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:38:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d9ce42bb-800b-4423-959d-dbaf88c0fe1c tempest-GroupSnapshotsV319Test-539841923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_ulbb7ozo {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:53 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_ulbb7ozo Sep 16 17:38:53 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:53 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af Sep 16 17:38:53 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:53 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_ulbb7ozo" returned: 0 in 0.437s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_ulbb7ozo {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d9ce42bb-800b-4423-959d-dbaf88c0fe1c tempest-GroupSnapshotsV319Test-539841923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af" returned: 0 in 0.560s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d9ce42bb-800b-4423-959d-dbaf88c0fe1c tempest-GroupSnapshotsV319Test-539841923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.f60b3b0f-51d9-4627-b9d4-ece608fb430b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:53 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:53 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.f60b3b0f-51d9-4627-b9d4-ece608fb430b Sep 16 17:38:53 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:53 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_ulbb7ozo Sep 16 17:38:53 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:54 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_ulbb7ozo" returned: 1 in 0.752s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_ulbb7ozo' failed. Not Retrying. {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:38:54 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f40c99a-3585-4f99-94d6-3a810dc8d056]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:38:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_bdvj7mxydevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:54 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d9ce42bb-800b-4423-959d-dbaf88c0fe1c tempest-GroupSnapshotsV319Test-539841923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.f60b3b0f-51d9-4627-b9d4-ece608fb430b" returned: 0 in 0.708s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d9ce42bb-800b-4423-959d-dbaf88c0fe1c tempest-GroupSnapshotsV319Test-539841923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.f60b3b0f-51d9-4627-b9d4-ece608fb430b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:54 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.f60b3b0f-51d9-4627-b9d4-ece608fb430b Sep 16 17:38:54 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:54 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_bdvj7mxydevstack@QuobyteHD Sep 16 17:38:54 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:54 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d9ce42bb-800b-4423-959d-dbaf88c0fe1c tempest-GroupSnapshotsV319Test-539841923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af.f60b3b0f-51d9-4627-b9d4-ece608fb430b" returned: 0 in 0.408s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:54 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d9ce42bb-800b-4423-959d-dbaf88c0fe1c tempest-GroupSnapshotsV319Test-539841923 None] Lock "cinder-quobyte-f60b3b0f-51d9-4627-b9d4-ece608fb430b" released by "_delete_snapshot" :: held 2.572s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:38:54 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d9ce42bb-800b-4423-959d-dbaf88c0fe1c tempest-GroupSnapshotsV319Test-539841923 None] Lock "cinder-quobyte-83ca28b6-e934-4528-9bae-32d5dea183af" released by "delete_snapshot" :: held 2.627s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:38:54 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_bdvj7mxydevstack@QuobyteHD" returned: 0 in 0.668s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:54 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] 81ac455d-f592-4ef7-8c27-23e4054a633b was qcow2, converting to qcow2 {{(pid=85899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 16 17:38:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_bdvj7mxydevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-55da318f-2c82-47ff-bc72-9f94452da684 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:55 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_bdvj7mxydevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-55da318f-2c82-47ff-bc72-9f94452da684 Sep 16 17:38:55 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:55 devstack cinder-volume[85899]: WARNING cinder.quota [None req-d9ce42bb-800b-4423-959d-dbaf88c0fe1c tempest-GroupSnapshotsV319Test-539841923 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1609094698 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1609094698, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:38:55 devstack cinder-volume[85899]: WARNING cinder.quota [None req-d9ce42bb-800b-4423-959d-dbaf88c0fe1c tempest-GroupSnapshotsV319Test-539841923 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1609094698 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1609094698, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:38:55 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-d9ce42bb-800b-4423-959d-dbaf88c0fe1c tempest-GroupSnapshotsV319Test-539841923 None] Created reservations ['aceafc71-cc4e-40e8-9682-a04f7dc69394', '9062fe82-3905-41ea-ac71-f5d753d8f722', '4b5c2f1e-1cc2-4c20-99f1-3354219bff35', '6c8f8b43-c56e-4083-8c87-3ba185d1317b'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:38:55 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-d9ce42bb-800b-4423-959d-dbaf88c0fe1c tempest-GroupSnapshotsV319Test-539841923 None] group_snapshot f5d2b67c-b1c5-49ba-9b48-4f18b190eb7e: deleted successfully Sep 16 17:38:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-821ad584-6f50-4571-9d93-47d8ccc27bbe tempest-GroupSnapshotsV319Test-539841923 None] Acquiring lock "cinder-quobyte-83ca28b6-e934-4528-9bae-32d5dea183af" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:38:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-821ad584-6f50-4571-9d93-47d8ccc27bbe tempest-GroupSnapshotsV319Test-539841923 None] Lock "cinder-quobyte-83ca28b6-e934-4528-9bae-32d5dea183af" acquired by "delete_volume" :: waited 0.091s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:38:56 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae28879d-2f25-49ec-aa79-5c0b6bd6eef9]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:38:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-821ad584-6f50-4571-9d93-47d8ccc27bbe tempest-GroupSnapshotsV319Test-539841923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:57 devstack sudo[89957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af Sep 16 17:38:57 devstack sudo[89957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:57 devstack sudo[89957]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-821ad584-6f50-4571-9d93-47d8ccc27bbe tempest-GroupSnapshotsV319Test-539841923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af" returned: 0 in 1.138s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-821ad584-6f50-4571-9d93-47d8ccc27bbe tempest-GroupSnapshotsV319Test-539841923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:57 devstack sudo[90010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af Sep 16 17:38:57 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:58 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-821ad584-6f50-4571-9d93-47d8ccc27bbe tempest-GroupSnapshotsV319Test-539841923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-83ca28b6-e934-4528-9bae-32d5dea183af" returned: 0 in 0.631s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-821ad584-6f50-4571-9d93-47d8ccc27bbe tempest-GroupSnapshotsV319Test-539841923 None] Lock "cinder-quobyte-83ca28b6-e934-4528-9bae-32d5dea183af" released by "delete_volume" :: held 2.002s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:38:58 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-821ad584-6f50-4571-9d93-47d8ccc27bbe tempest-GroupSnapshotsV319Test-539841923 None] Created reservations ['a46fcbeb-2c9a-4e51-9aa0-8eaf552c99db'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:38:58 devstack cinder-volume[85899]: WARNING cinder.quota [None req-821ad584-6f50-4571-9d93-47d8ccc27bbe tempest-GroupSnapshotsV319Test-539841923 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1609094698 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1609094698, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:38:58 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-821ad584-6f50-4571-9d93-47d8ccc27bbe tempest-GroupSnapshotsV319Test-539841923 None] Created reservations ['a3b3f643-e775-43f0-8da3-7c295163fece', '2a770df4-f0f2-4abb-ba25-a4b936ac54d4', 'dfe60587-e269-4c8a-a8a2-c49b75e644b3', '2043ff2c-934a-4544-9c0f-48e9e74b8db8'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:38:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-821ad584-6f50-4571-9d93-47d8ccc27bbe tempest-GroupSnapshotsV319Test-539841923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:38:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-821ad584-6f50-4571-9d93-47d8ccc27bbe tempest-GroupSnapshotsV319Test-539841923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:38:59 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-821ad584-6f50-4571-9d93-47d8ccc27bbe tempest-GroupSnapshotsV319Test-539841923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:38:59 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:59 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-821ad584-6f50-4571-9d93-47d8ccc27bbe tempest-GroupSnapshotsV319Test-539841923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:38:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-821ad584-6f50-4571-9d93-47d8ccc27bbe tempest-GroupSnapshotsV319Test-539841923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:38:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-821ad584-6f50-4571-9d93-47d8ccc27bbe tempest-GroupSnapshotsV319Test-539841923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_bdvj7mxydevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-55da318f-2c82-47ff-bc72-9f94452da684" returned: 0 in 4.103s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:59 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_bdvj7mxydevstack@QuobyteHD, size 112.00 MB, duration 4.11 sec, destination /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-55da318f-2c82-47ff-bc72-9f94452da684 {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:38:59 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Converted 112.00 MB image at 27.28 MB/s Sep 16 17:38:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-55da318f-2c82-47ff-bc72-9f94452da684 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:38:59 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:38:59 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:59 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-55da318f-2c82-47ff-bc72-9f94452da684 1G Sep 16 17:38:59 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:38:59 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Sep 16 17:38:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-821ad584-6f50-4571-9d93-47d8ccc27bbe tempest-GroupSnapshotsV319Test-539841923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.902s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:38:59 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-821ad584-6f50-4571-9d93-47d8ccc27bbe tempest-GroupSnapshotsV319Test-539841923 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:38:59 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-55da318f-2c82-47ff-bc72-9f94452da684 1G" returned: 0 in 0.905s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:00 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Downloaded image 81ac455d-f592-4ef7-8c27-23e4054a633b ((None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}])) to volume 55da318f-2c82-47ff-bc72-9f94452da684 successfully. {{(pid=85899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 17:39:00 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Temporary image 81ac455d-f592-4ef7-8c27-23e4054a633b for user 6923d5b698034d78977cb0827c393c69 is deleted. {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 16 17:39:00 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Marking volume 55da318f-2c82-47ff-bc72-9f94452da684 as bootable. {{(pid=85899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 17:39:00 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-821ad584-6f50-4571-9d93-47d8ccc27bbe tempest-GroupSnapshotsV319Test-539841923 None] Delete group completed successfully. Sep 16 17:39:00 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Copying metadata from image 81ac455d-f592-4ef7-8c27-23e4054a633b to 55da318f-2c82-47ff-bc72-9f94452da684. {{(pid=85899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 17:39:00 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Creating volume glance metadata for volume 55da318f-2c82-47ff-bc72-9f94452da684 backed by image 81ac455d-f592-4ef7-8c27-23e4054a633b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 17:39:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b57a9e-0b43-4766-877c-bcbdcdb9c7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55da318f-2c82-47ff-bc72-9f94452da684', 'volume_size': 1, 'image_id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '124a9fc6f0b448c1afab7b2b666efe75', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'created_at': datetime.datetime(2026, 9, 16, 15, 30, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 30, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81ac455d-f592-4ef7-8c27-23e4054a633b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b1b4374-94df-414a-95a4-16162cbe2dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:00 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Volume volume-55da318f-2c82-47ff-bc72-9f94452da684 (55da318f-2c82-47ff-bc72-9f94452da684): created successfully Sep 16 17:39:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b1b4374-94df-414a-95a4-16162cbe2dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Flow 'volume_create_manager' (fe83dedf-1812-4220-9ce4-d570eb1fa245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:39:00 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-d1695aab-49c1-4842-85c5-d0aeacc97801 tempest-ServerActionsTestOtherA-1725898912 None] Created volume successfully. Sep 16 17:39:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:39:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:39:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:39:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:02 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:39:02 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:02 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.573s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:39:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager._thread_info {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:39:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread count: 28 {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:39:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread info: [<_MainThread(MainThread, started 123748124422272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:39:03 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:39:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Flow 'volume_create_manager' (cf520984-1d1a-4a23-9e66-80de0f0b1b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:39:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26a9a61-0c8b-4a25-bfea-50808aa01b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26a9a61-0c8b-4a25-bfea-50808aa01b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1140941614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d96817d-5701-4e06-9c50-eab7441fcb78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508c5807b6e14b559c171ed594380a74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:39:03Z,use_quota=True,user_id='e6b0f29cb3f941c59af8648e2068ed9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f59ac758-95b9-40ba-8344-d23e58d8e3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f59ac758-95b9-40ba-8344-d23e58d8e3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eafe01c-5599-42c6-b171-3d8130b788c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eafe01c-5599-42c6-b171-3d8130b788c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d96817d-5701-4e06-9c50-eab7441fcb78', 'volume_name': 'volume-9d96817d-5701-4e06-9c50-eab7441fcb78', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d17210d-1eea-4b6b-8a6f-c475f366d6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d17210d-1eea-4b6b-8a6f-c475f366d6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a2d2b8c-bc19-4859-9b52-88746a60f447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:03 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Volume 9d96817d-5701-4e06-9c50-eab7441fcb78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d96817d-5701-4e06-9c50-eab7441fcb78', 'volume_size': 1} Sep 16 17:39:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1140941614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d96817d-5701-4e06-9c50-eab7441fcb78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508c5807b6e14b559c171ed594380a74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:39:03Z,use_quota=True,user_id='e6b0f29cb3f941c59af8648e2068ed9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:39:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Creating volume 9d96817d-5701-4e06-9c50-eab7441fcb78 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:39:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:39:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:39:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:39:03 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:39:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9d96817d-5701-4e06-9c50-eab7441fcb78 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:03 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9d96817d-5701-4e06-9c50-eab7441fcb78 1073741824 Sep 16 17:39:03 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:04 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9d96817d-5701-4e06-9c50-eab7441fcb78 1073741824" returned: 0 in 0.825s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9d96817d-5701-4e06-9c50-eab7441fcb78 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:04 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9d96817d-5701-4e06-9c50-eab7441fcb78 Sep 16 17:39:04 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:04 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9d96817d-5701-4e06-9c50-eab7441fcb78" returned: 0 in 0.497s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:04 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:39:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a2d2b8c-bc19-4859-9b52-88746a60f447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d96817d-5701-4e06-9c50-eab7441fcb78', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e302aa27-df51-48b3-ad34-db8ecfed5902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:04 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Volume volume-9d96817d-5701-4e06-9c50-eab7441fcb78 (9d96817d-5701-4e06-9c50-eab7441fcb78): created successfully Sep 16 17:39:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e302aa27-df51-48b3-ad34-db8ecfed5902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:05 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Flow 'volume_create_manager' (cf520984-1d1a-4a23-9e66-80de0f0b1b6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:39:05 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-42c62112-4d0e-4660-9570-31b4212ca30f tempest-ServersNegativeTestJSON-684565635 None] Created volume successfully. Sep 16 17:39:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-86d1fe59-c52c-43fd-b915-21f93c86c463 req-c192f459-9e03-48c5-9d5a-90b43615b126 tempest-ServerActionsTestOtherA-1725898912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-86d1fe59-c52c-43fd-b915-21f93c86c463 req-c192f459-9e03-48c5-9d5a-90b43615b126 tempest-ServerActionsTestOtherA-1725898912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-86d1fe59-c52c-43fd-b915-21f93c86c463 req-c192f459-9e03-48c5-9d5a-90b43615b126 tempest-ServerActionsTestOtherA-1725898912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:05 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-86d1fe59-c52c-43fd-b915-21f93c86c463 req-c192f459-9e03-48c5-9d5a-90b43615b126 tempest-ServerActionsTestOtherA-1725898912 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7', 'name': 'volume-55da318f-2c82-47ff-bc72-9f94452da684', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '862b993b-de04-4a1f-a8e3-873f8145288e', 'enforce_multipath': True} {{(pid=85899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4920}} Sep 16 17:39:06 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-86d1fe59-c52c-43fd-b915-21f93c86c463 req-c192f459-9e03-48c5-9d5a-90b43615b126 tempest-ServerActionsTestOtherA-1725898912 None] attachment_update completed successfully. Sep 16 17:39:08 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:39:08 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Flow 'volume_create_manager' (873adbc2-ade8-489d-9d7a-d49f6bcdfb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:39:08 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea8f13b-c1c5-45c2-83ba-e597bd81fbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:08 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea8f13b-c1c5-45c2-83ba-e597bd81fbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1528990892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d19b78d-f11e-436f-905c-04125903b7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508c5807b6e14b559c171ed594380a74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:39:08Z,use_quota=True,user_id='e6b0f29cb3f941c59af8648e2068ed9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:08 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd66125-b02a-4af3-9d6f-02800cb67e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:08 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd66125-b02a-4af3-9d6f-02800cb67e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:08 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bcd790c-d8b1-46e8-96fe-9aa6dcf93dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:08 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bcd790c-d8b1-46e8-96fe-9aa6dcf93dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d19b78d-f11e-436f-905c-04125903b7ca', 'volume_name': 'volume-3d19b78d-f11e-436f-905c-04125903b7ca', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:08 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6eb97e2-38c0-478c-beee-9a3b98d0107b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:08 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6eb97e2-38c0-478c-beee-9a3b98d0107b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:08 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (980a3184-daf6-4e98-aca5-3487c960916a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:08 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Volume 3d19b78d-f11e-436f-905c-04125903b7ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d19b78d-f11e-436f-905c-04125903b7ca', 'volume_size': 1} Sep 16 17:39:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:08 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1528990892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d19b78d-f11e-436f-905c-04125903b7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508c5807b6e14b559c171ed594380a74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:39:08Z,use_quota=True,user_id='e6b0f29cb3f941c59af8648e2068ed9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:39:08 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Creating volume 3d19b78d-f11e-436f-905c-04125903b7ca {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:39:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:08 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:39:08 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:39:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:08 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:39:08 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:39:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3d19b78d-f11e-436f-905c-04125903b7ca 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:08 devstack sudo[90092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3d19b78d-f11e-436f-905c-04125903b7ca 1073741824 Sep 16 17:39:08 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:09 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3d19b78d-f11e-436f-905c-04125903b7ca 1073741824" returned: 0 in 0.709s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3d19b78d-f11e-436f-905c-04125903b7ca {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:09 devstack sudo[90106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3d19b78d-f11e-436f-905c-04125903b7ca Sep 16 17:39:09 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:09 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3d19b78d-f11e-436f-905c-04125903b7ca" returned: 0 in 0.407s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:39:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (980a3184-daf6-4e98-aca5-3487c960916a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d19b78d-f11e-436f-905c-04125903b7ca', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f4e87b-a9a4-488c-8381-fdc7ed1bf7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:09 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Volume volume-3d19b78d-f11e-436f-905c-04125903b7ca (3d19b78d-f11e-436f-905c-04125903b7ca): created successfully Sep 16 17:39:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f4e87b-a9a4-488c-8381-fdc7ed1bf7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Flow 'volume_create_manager' (873adbc2-ade8-489d-9d7a-d49f6bcdfb36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:39:09 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-75115d2c-338c-4371-90d8-f8561d9266f7 tempest-ServersNegativeTestJSON-684565635 None] Created volume successfully. Sep 16 17:39:10 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-83a98c13-2d5b-4f9a-a848-9ae23525866a tempest-GroupsTest-814532688 None] Group tempest-Group1-1411186306: creating Sep 16 17:39:10 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-83a98c13-2d5b-4f9a-a848-9ae23525866a tempest-GroupsTest-814532688 None] Group tempest-Group1-1411186306: created successfully Sep 16 17:39:10 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-83a98c13-2d5b-4f9a-a848-9ae23525866a tempest-GroupsTest-814532688 None] Create group completed successfully. Sep 16 17:39:11 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6b398ac0-9c2c-4d47-8299-76ea97190f7e tempest-ServersNegativeTestJSON-684565635 None] Acquiring lock "cinder-3d19b78d-f11e-436f-905c-04125903b7ca-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:39:11 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6b398ac0-9c2c-4d47-8299-76ea97190f7e tempest-ServersNegativeTestJSON-684565635 None] Lock "cinder-3d19b78d-f11e-436f-905c-04125903b7ca-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:39:11 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6b398ac0-9c2c-4d47-8299-76ea97190f7e tempest-ServersNegativeTestJSON-684565635 None] Acquiring lock "cinder-quobyte-3d19b78d-f11e-436f-905c-04125903b7ca" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:39:11 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6b398ac0-9c2c-4d47-8299-76ea97190f7e tempest-ServersNegativeTestJSON-684565635 None] Lock "cinder-quobyte-3d19b78d-f11e-436f-905c-04125903b7ca" acquired by "delete_volume" :: waited 0.050s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:39:11 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20da4fe-cec6-4557-ae71-1bd1cbfa42e8]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:39:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6b398ac0-9c2c-4d47-8299-76ea97190f7e tempest-ServersNegativeTestJSON-684565635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3d19b78d-f11e-436f-905c-04125903b7ca {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:12 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3d19b78d-f11e-436f-905c-04125903b7ca Sep 16 17:39:12 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:12 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-e595edef-a736-45ac-b36d-966d96701607 tempest-GroupsTest-814532688 None] Group tempest-Group2-2063697198: creating Sep 16 17:39:12 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-e595edef-a736-45ac-b36d-966d96701607 tempest-GroupsTest-814532688 None] Group tempest-Group2-2063697198: created successfully Sep 16 17:39:12 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-e595edef-a736-45ac-b36d-966d96701607 tempest-GroupsTest-814532688 None] Create group completed successfully. Sep 16 17:39:12 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6b398ac0-9c2c-4d47-8299-76ea97190f7e tempest-ServersNegativeTestJSON-684565635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3d19b78d-f11e-436f-905c-04125903b7ca" returned: 0 in 0.647s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6b398ac0-9c2c-4d47-8299-76ea97190f7e tempest-ServersNegativeTestJSON-684565635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3d19b78d-f11e-436f-905c-04125903b7ca {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:12 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3d19b78d-f11e-436f-905c-04125903b7ca Sep 16 17:39:12 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:12 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6b398ac0-9c2c-4d47-8299-76ea97190f7e tempest-ServersNegativeTestJSON-684565635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3d19b78d-f11e-436f-905c-04125903b7ca" returned: 0 in 0.330s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:12 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6b398ac0-9c2c-4d47-8299-76ea97190f7e tempest-ServersNegativeTestJSON-684565635 None] Lock "cinder-quobyte-3d19b78d-f11e-436f-905c-04125903b7ca" released by "delete_volume" :: held 1.041s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:39:12 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-6b398ac0-9c2c-4d47-8299-76ea97190f7e tempest-ServersNegativeTestJSON-684565635 None] Created reservations ['19e92e4c-bcfa-4d5e-aa7f-b0de47de6f97', '980a3334-ae74-4696-acdd-93f1c5c6276f', '8966d8c1-d9d1-47a2-b8e9-99818cf7826a', '8bf2f698-9f20-4132-b979-153c3a79d243'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:39:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6b398ac0-9c2c-4d47-8299-76ea97190f7e tempest-ServersNegativeTestJSON-684565635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6b398ac0-9c2c-4d47-8299-76ea97190f7e tempest-ServersNegativeTestJSON-684565635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:13 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6b398ac0-9c2c-4d47-8299-76ea97190f7e tempest-ServersNegativeTestJSON-684565635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:39:13 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6b398ac0-9c2c-4d47-8299-76ea97190f7e tempest-ServersNegativeTestJSON-684565635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:39:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6b398ac0-9c2c-4d47-8299-76ea97190f7e tempest-ServersNegativeTestJSON-684565635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6b398ac0-9c2c-4d47-8299-76ea97190f7e tempest-ServersNegativeTestJSON-684565635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:13 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:39:13 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:13 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6b398ac0-9c2c-4d47-8299-76ea97190f7e tempest-ServersNegativeTestJSON-684565635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.238s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:13 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-6b398ac0-9c2c-4d47-8299-76ea97190f7e tempest-ServersNegativeTestJSON-684565635 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:39:13 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-6b398ac0-9c2c-4d47-8299-76ea97190f7e tempest-ServersNegativeTestJSON-684565635 None] Deleted volume successfully. Sep 16 17:39:13 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6b398ac0-9c2c-4d47-8299-76ea97190f7e tempest-ServersNegativeTestJSON-684565635 None] Lock "cinder-3d19b78d-f11e-436f-905c-04125903b7ca-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:39:13 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-75b686fb-4217-4f51-8121-1a6b7704fb84 tempest-ServersNegativeTestJSON-684565635 None] Acquiring lock "cinder-9d96817d-5701-4e06-9c50-eab7441fcb78-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-75b686fb-4217-4f51-8121-1a6b7704fb84 tempest-ServersNegativeTestJSON-684565635 None] Lock "cinder-9d96817d-5701-4e06-9c50-eab7441fcb78-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-75b686fb-4217-4f51-8121-1a6b7704fb84 tempest-ServersNegativeTestJSON-684565635 None] Acquiring lock "cinder-quobyte-9d96817d-5701-4e06-9c50-eab7441fcb78" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-75b686fb-4217-4f51-8121-1a6b7704fb84 tempest-ServersNegativeTestJSON-684565635 None] Lock "cinder-quobyte-9d96817d-5701-4e06-9c50-eab7441fcb78" acquired by "delete_volume" :: waited 0.026s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c068ad26-974c-4585-a887-916f336e4a53]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-75b686fb-4217-4f51-8121-1a6b7704fb84 tempest-ServersNegativeTestJSON-684565635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9d96817d-5701-4e06-9c50-eab7441fcb78 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Flow 'volume_create_manager' (acdd84ff-d735-4817-bb33-314783bbe2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c3f0f2-e2b7-4f78-9fb6-4b689cca5dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:14 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9d96817d-5701-4e06-9c50-eab7441fcb78 Sep 16 17:39:14 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c3f0f2-e2b7-4f78-9fb6-4b689cca5dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-697970502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=64dcaf56-169a-4b44-9df9-5580db0a54eb,host='devstack@QuobyteHD#QuobyteHD',id=0684ac1b-9519-45d5-a436-061c7f9c6576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec69ecfd39c749808eb4d1d935191c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:39:14Z,use_quota=True,user_id='f4b3763b2f6f460e9391a6c9c86de347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(980cf436-7e81-4d8d-8222-df2e8a6d124e),volume_type_id=980cf436-7e81-4d8d-8222-df2e8a6d124e)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d212c8-f962-4e4b-8731-26f0d98dee91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d212c8-f962-4e4b-8731-26f0d98dee91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4015f1c-4efa-47cb-801f-40febb9cff8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4015f1c-4efa-47cb-801f-40febb9cff8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0684ac1b-9519-45d5-a436-061c7f9c6576', 'volume_name': 'volume-0684ac1b-9519-45d5-a436-061c7f9c6576', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8411e30d-32d7-41fa-ae00-9e6465457a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8411e30d-32d7-41fa-ae00-9e6465457a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b24e61-6f2b-4070-bd76-ff9155b9c240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:14 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Volume 0684ac1b-9519-45d5-a436-061c7f9c6576: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0684ac1b-9519-45d5-a436-061c7f9c6576', 'volume_size': 1} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=64dcaf56-169a-4b44-9df9-5580db0a54eb,created_at=2026-09-16T15:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-697970502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=64dcaf56-169a-4b44-9df9-5580db0a54eb,host='devstack@QuobyteHD#QuobyteHD',id=0684ac1b-9519-45d5-a436-061c7f9c6576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec69ecfd39c749808eb4d1d935191c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:39:14Z,use_quota=True,user_id='f4b3763b2f6f460e9391a6c9c86de347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(980cf436-7e81-4d8d-8222-df2e8a6d124e),volume_type_id=980cf436-7e81-4d8d-8222-df2e8a6d124e)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Creating volume 0684ac1b-9519-45d5-a436-061c7f9c6576 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:39:14 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0684ac1b-9519-45d5-a436-061c7f9c6576 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:14 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0684ac1b-9519-45d5-a436-061c7f9c6576 1073741824 Sep 16 17:39:14 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:14 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-75b686fb-4217-4f51-8121-1a6b7704fb84 tempest-ServersNegativeTestJSON-684565635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9d96817d-5701-4e06-9c50-eab7441fcb78" returned: 0 in 0.459s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-75b686fb-4217-4f51-8121-1a6b7704fb84 tempest-ServersNegativeTestJSON-684565635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9d96817d-5701-4e06-9c50-eab7441fcb78 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:14 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9d96817d-5701-4e06-9c50-eab7441fcb78 Sep 16 17:39:14 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:15 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-75b686fb-4217-4f51-8121-1a6b7704fb84 tempest-ServersNegativeTestJSON-684565635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9d96817d-5701-4e06-9c50-eab7441fcb78" returned: 0 in 0.355s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:15 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:15 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-75b686fb-4217-4f51-8121-1a6b7704fb84 tempest-ServersNegativeTestJSON-684565635 None] Lock "cinder-quobyte-9d96817d-5701-4e06-9c50-eab7441fcb78" released by "delete_volume" :: held 0.889s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:39:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0684ac1b-9519-45d5-a436-061c7f9c6576 1073741824" returned: 0 in 0.629s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0684ac1b-9519-45d5-a436-061c7f9c6576 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:15 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-75b686fb-4217-4f51-8121-1a6b7704fb84 tempest-ServersNegativeTestJSON-684565635 None] Created reservations ['1369afe7-111b-4536-8f39-476ff29beeec', 'a788c997-b4c5-4e1e-9aef-8b8b0234624b', 'fc0de04b-075c-4643-ac76-0765d33726a4', 'd2c878d2-f624-46a5-84ee-7e9b1296f7bb'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:39:15 devstack sudo[90624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0684ac1b-9519-45d5-a436-061c7f9c6576 Sep 16 17:39:15 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-75b686fb-4217-4f51-8121-1a6b7704fb84 tempest-ServersNegativeTestJSON-684565635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-75b686fb-4217-4f51-8121-1a6b7704fb84 tempest-ServersNegativeTestJSON-684565635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-75b686fb-4217-4f51-8121-1a6b7704fb84 tempest-ServersNegativeTestJSON-684565635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:39:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-75b686fb-4217-4f51-8121-1a6b7704fb84 tempest-ServersNegativeTestJSON-684565635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:39:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-75b686fb-4217-4f51-8121-1a6b7704fb84 tempest-ServersNegativeTestJSON-684565635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-75b686fb-4217-4f51-8121-1a6b7704fb84 tempest-ServersNegativeTestJSON-684565635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:15 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:39:15 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:15 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0684ac1b-9519-45d5-a436-061c7f9c6576" returned: 0 in 0.446s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:39:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:15 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-75b686fb-4217-4f51-8121-1a6b7704fb84 tempest-ServersNegativeTestJSON-684565635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.322s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:15 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-75b686fb-4217-4f51-8121-1a6b7704fb84 tempest-ServersNegativeTestJSON-684565635 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:39:15 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-75b686fb-4217-4f51-8121-1a6b7704fb84 tempest-ServersNegativeTestJSON-684565635 None] Deleted volume successfully. Sep 16 17:39:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b24e61-6f2b-4070-bd76-ff9155b9c240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0684ac1b-9519-45d5-a436-061c7f9c6576', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3812235c-bb5a-4af5-9174-a85063464c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:15 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Volume volume-0684ac1b-9519-45d5-a436-061c7f9c6576 (0684ac1b-9519-45d5-a436-061c7f9c6576): created successfully Sep 16 17:39:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3812235c-bb5a-4af5-9174-a85063464c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Flow 'volume_create_manager' (acdd84ff-d735-4817-bb33-314783bbe2f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:39:15 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-75b686fb-4217-4f51-8121-1a6b7704fb84 tempest-ServersNegativeTestJSON-684565635 None] Lock "cinder-9d96817d-5701-4e06-9c50-eab7441fcb78-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:39:15 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-7fd5ff24-8075-43dc-ac1c-38d2017644ca tempest-GroupsTest-814532688 None] Created volume successfully. Sep 16 17:39:18 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9778ff6d-900f-4343-a894-903222abca5c tempest-GroupsTest-814532688 None] Acquiring lock "cinder-quobyte-0684ac1b-9519-45d5-a436-061c7f9c6576" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:39:18 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9778ff6d-900f-4343-a894-903222abca5c tempest-GroupsTest-814532688 None] Lock "cinder-quobyte-0684ac1b-9519-45d5-a436-061c7f9c6576" acquired by "delete_volume" :: waited 0.025s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:39:18 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d5bc59-62c0-4925-9d76-279ee4f88dcf]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:39:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9778ff6d-900f-4343-a894-903222abca5c tempest-GroupsTest-814532688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0684ac1b-9519-45d5-a436-061c7f9c6576 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:18 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0684ac1b-9519-45d5-a436-061c7f9c6576 Sep 16 17:39:18 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:19 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9778ff6d-900f-4343-a894-903222abca5c tempest-GroupsTest-814532688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0684ac1b-9519-45d5-a436-061c7f9c6576" returned: 0 in 0.995s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9778ff6d-900f-4343-a894-903222abca5c tempest-GroupsTest-814532688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0684ac1b-9519-45d5-a436-061c7f9c6576 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:19 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0684ac1b-9519-45d5-a436-061c7f9c6576 Sep 16 17:39:19 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:20 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9778ff6d-900f-4343-a894-903222abca5c tempest-GroupsTest-814532688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0684ac1b-9519-45d5-a436-061c7f9c6576" returned: 0 in 0.756s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9778ff6d-900f-4343-a894-903222abca5c tempest-GroupsTest-814532688 None] Lock "cinder-quobyte-0684ac1b-9519-45d5-a436-061c7f9c6576" released by "delete_volume" :: held 1.853s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:39:20 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-9778ff6d-900f-4343-a894-903222abca5c tempest-GroupsTest-814532688 None] Created reservations ['5190f068-5ae3-4ab5-9555-39684dee043e'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:39:20 devstack cinder-volume[85899]: WARNING cinder.quota [None req-9778ff6d-900f-4343-a894-903222abca5c tempest-GroupsTest-814532688 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-570726244 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-570726244, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:39:20 devstack cinder-volume[85899]: WARNING cinder.quota [None req-9778ff6d-900f-4343-a894-903222abca5c tempest-GroupsTest-814532688 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-570726244 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-570726244, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:39:20 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-9778ff6d-900f-4343-a894-903222abca5c tempest-GroupsTest-814532688 None] Created reservations ['5c752a46-dc6b-4c38-93aa-dc8b787b68fe', 'b815d262-dc9a-4c16-98ff-f4f8cbe97ff8', '613f5749-48f0-414a-be09-999952f5cc5a', '6713e5b0-0ff1-48db-a333-37e7d44aa916'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:39:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9778ff6d-900f-4343-a894-903222abca5c tempest-GroupsTest-814532688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9778ff6d-900f-4343-a894-903222abca5c tempest-GroupsTest-814532688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9778ff6d-900f-4343-a894-903222abca5c tempest-GroupsTest-814532688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:39:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9778ff6d-900f-4343-a894-903222abca5c tempest-GroupsTest-814532688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:39:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9778ff6d-900f-4343-a894-903222abca5c tempest-GroupsTest-814532688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9778ff6d-900f-4343-a894-903222abca5c tempest-GroupsTest-814532688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:21 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:39:21 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:21 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9778ff6d-900f-4343-a894-903222abca5c tempest-GroupsTest-814532688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.544s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:21 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-9778ff6d-900f-4343-a894-903222abca5c tempest-GroupsTest-814532688 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:39:21 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-9778ff6d-900f-4343-a894-903222abca5c tempest-GroupsTest-814532688 None] Delete group completed successfully. Sep 16 17:39:21 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-11ecf89c-58a2-4ab2-a70a-e171b6094924 tempest-GroupsTest-814532688 None] Created reservations ['7d36a153-affb-431b-b0b3-77a5711b37ef'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:39:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-11ecf89c-58a2-4ab2-a70a-e171b6094924 tempest-GroupsTest-814532688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-11ecf89c-58a2-4ab2-a70a-e171b6094924 tempest-GroupsTest-814532688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-11ecf89c-58a2-4ab2-a70a-e171b6094924 tempest-GroupsTest-814532688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:39:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-11ecf89c-58a2-4ab2-a70a-e171b6094924 tempest-GroupsTest-814532688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:39:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-11ecf89c-58a2-4ab2-a70a-e171b6094924 tempest-GroupsTest-814532688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-11ecf89c-58a2-4ab2-a70a-e171b6094924 tempest-GroupsTest-814532688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:21 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:39:21 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:22 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-11ecf89c-58a2-4ab2-a70a-e171b6094924 tempest-GroupsTest-814532688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.387s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:22 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-11ecf89c-58a2-4ab2-a70a-e171b6094924 tempest-GroupsTest-814532688 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:39:22 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-11ecf89c-58a2-4ab2-a70a-e171b6094924 tempest-GroupsTest-814532688 None] Delete group completed successfully. Sep 16 17:39:23 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-969fe7cb-6aee-43e1-bf38-b28b1894418f tempest-GroupsTest-814532688 None] Group tempest-GroupsTest-Group-446115032: creating Sep 16 17:39:23 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-969fe7cb-6aee-43e1-bf38-b28b1894418f tempest-GroupsTest-814532688 None] Group tempest-GroupsTest-Group-446115032: created successfully Sep 16 17:39:23 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-969fe7cb-6aee-43e1-bf38-b28b1894418f tempest-GroupsTest-814532688 None] Create group completed successfully. Sep 16 17:39:25 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=79,cinder:UPDATE=66,cinder:INSERT=23,cinder:DELETE=3 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:39:25 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-988bea17-06de-4754-89cb-35507cc454fe req-deff4266-1f36-4781-9f24-922070d6b277 tempest-ServerActionsTestOtherA-1725898912 None] Terminate volume connection completed successfully. Sep 16 17:39:25 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-988bea17-06de-4754-89cb-35507cc454fe req-deff4266-1f36-4781-9f24-922070d6b277 tempest-ServerActionsTestOtherA-1725898912 None] Deleting attachment 862b993b-de04-4a1f-a8e3-873f8145288e. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:39:25 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:39:25 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Flow 'volume_create_manager' (ccf59da5-9110-45fb-9342-c7f4e12f786a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca8448e-29fc-4029-bdd3-4063a4d3dc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca8448e-29fc-4029-bdd3-4063a4d3dc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-340639210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871867ef-d231-4ff1-9a0c-9a19140c2c80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6169b1cad434069b6f65ebc3dab5bdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:39:26Z,use_quota=True,user_id='0bb5fa0ec19c4c55ba0bd57b2fc2c9d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3fda23f-e797-47ce-89c7-51ba535a8c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3fda23f-e797-47ce-89c7-51ba535a8c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9693c4-3388-479e-9759-552482bf2294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9693c4-3388-479e-9759-552482bf2294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '871867ef-d231-4ff1-9a0c-9a19140c2c80', 'volume_name': 'volume-871867ef-d231-4ff1-9a0c-9a19140c2c80', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6101f489-bf81-47db-84d2-2b1d3227919b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6101f489-bf81-47db-84d2-2b1d3227919b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e05c247-0de2-4f5e-9d58-f54c903c44b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:26 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Volume 871867ef-d231-4ff1-9a0c-9a19140c2c80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-871867ef-d231-4ff1-9a0c-9a19140c2c80', 'volume_size': 1} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-340639210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871867ef-d231-4ff1-9a0c-9a19140c2c80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6169b1cad434069b6f65ebc3dab5bdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:39:26Z,use_quota=True,user_id='0bb5fa0ec19c4c55ba0bd57b2fc2c9d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Creating volume 871867ef-d231-4ff1-9a0c-9a19140c2c80 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:39:26 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-871867ef-d231-4ff1-9a0c-9a19140c2c80 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:26 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-871867ef-d231-4ff1-9a0c-9a19140c2c80 1073741824 Sep 16 17:39:26 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Flow 'volume_create_manager' (d2d82a13-ea0d-4fd9-808d-65e4fe1f28f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5047ee5c-82c5-42be-af9e-85f861a54faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5047ee5c-82c5-42be-af9e-85f861a54faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1962231122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6d5868d-698c-4b6d-a24d-2c4efa7b1bdc,host='devstack@QuobyteHD#QuobyteHD',id=eb1d906a-a8fe-437a-a626-552936894986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec69ecfd39c749808eb4d1d935191c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:39:26Z,use_quota=True,user_id='f4b3763b2f6f460e9391a6c9c86de347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7643624d-cd29-4bd7-b36d-52deb1bd9bb0),volume_type_id=7643624d-cd29-4bd7-b36d-52deb1bd9bb0)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f803803d-0e42-46b5-8d4c-f5997cb7b31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f803803d-0e42-46b5-8d4c-f5997cb7b31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c782f8c1-5748-4093-9251-e0f2594c6da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c782f8c1-5748-4093-9251-e0f2594c6da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb1d906a-a8fe-437a-a626-552936894986', 'volume_name': 'volume-eb1d906a-a8fe-437a-a626-552936894986', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60cb2283-fe63-41de-9d9c-fcd99b6533fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60cb2283-fe63-41de-9d9c-fcd99b6533fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1619bad2-65f7-4a8c-a877-55a3aeed9a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:26 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Volume eb1d906a-a8fe-437a-a626-552936894986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb1d906a-a8fe-437a-a626-552936894986', 'volume_size': 1} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:26 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-871867ef-d231-4ff1-9a0c-9a19140c2c80 1073741824" returned: 0 in 0.601s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=76,cinder:UPDATE=78,cinder:INSERT=19,cinder:DELETE=4 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-871867ef-d231-4ff1-9a0c-9a19140c2c80 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:26 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-871867ef-d231-4ff1-9a0c-9a19140c2c80 Sep 16 17:39:26 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:26 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-871867ef-d231-4ff1-9a0c-9a19140c2c80" returned: 0 in 0.257s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.617s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c6d5868d-698c-4b6d-a24d-2c4efa7b1bdc,created_at=2026-09-16T15:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1962231122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6d5868d-698c-4b6d-a24d-2c4efa7b1bdc,host='devstack@QuobyteHD#QuobyteHD',id=eb1d906a-a8fe-437a-a626-552936894986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec69ecfd39c749808eb4d1d935191c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:39:26Z,use_quota=True,user_id='f4b3763b2f6f460e9391a6c9c86de347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7643624d-cd29-4bd7-b36d-52deb1bd9bb0),volume_type_id=7643624d-cd29-4bd7-b36d-52deb1bd9bb0)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Creating volume eb1d906a-a8fe-437a-a626-552936894986 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:39:26 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:39:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eb1d906a-a8fe-437a-a626-552936894986 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e05c247-0de2-4f5e-9d58-f54c903c44b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-871867ef-d231-4ff1-9a0c-9a19140c2c80', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f203ba0-d905-4eb6-9a14-6e9dc432d234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:27 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eb1d906a-a8fe-437a-a626-552936894986 1073741824 Sep 16 17:39:27 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:27 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Volume volume-871867ef-d231-4ff1-9a0c-9a19140c2c80 (871867ef-d231-4ff1-9a0c-9a19140c2c80): created successfully Sep 16 17:39:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f203ba0-d905-4eb6-9a14-6e9dc432d234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Flow 'volume_create_manager' (ccf59da5-9110-45fb-9342-c7f4e12f786a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:39:27 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-e66ccc64-38cb-4828-a0b4-c3ab71d63846 tempest-AttachVolumeNegativeTest-195502489 None] Created volume successfully. Sep 16 17:39:27 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eb1d906a-a8fe-437a-a626-552936894986 1073741824" returned: 0 in 0.634s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-988bea17-06de-4754-89cb-35507cc454fe req-d26468b5-a12d-4616-8d85-b1dda1aed3c8 tempest-ServerActionsTestOtherA-1725898912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eb1d906a-a8fe-437a-a626-552936894986 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:27 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eb1d906a-a8fe-437a-a626-552936894986 Sep 16 17:39:27 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:27 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eb1d906a-a8fe-437a-a626-552936894986" returned: 0 in 0.304s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:27 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:39:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-988bea17-06de-4754-89cb-35507cc454fe req-d26468b5-a12d-4616-8d85-b1dda1aed3c8 tempest-ServerActionsTestOtherA-1725898912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.337s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-988bea17-06de-4754-89cb-35507cc454fe req-d26468b5-a12d-4616-8d85-b1dda1aed3c8 tempest-ServerActionsTestOtherA-1725898912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1619bad2-65f7-4a8c-a877-55a3aeed9a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb1d906a-a8fe-437a-a626-552936894986', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3a7738-bd93-4ee4-8fd3-c84791ebab38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:28 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Volume volume-eb1d906a-a8fe-437a-a626-552936894986 (eb1d906a-a8fe-437a-a626-552936894986): created successfully Sep 16 17:39:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3a7738-bd93-4ee4-8fd3-c84791ebab38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Flow 'volume_create_manager' (d2d82a13-ea0d-4fd9-808d-65e4fe1f28f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:39:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-988bea17-06de-4754-89cb-35507cc454fe req-d26468b5-a12d-4616-8d85-b1dda1aed3c8 tempest-ServerActionsTestOtherA-1725898912 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7', 'name': 'volume-55da318f-2c82-47ff-bc72-9f94452da684', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a926897-fcb5-484b-9e83-ac3ad09be18e', 'enforce_multipath': True} {{(pid=85899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4920}} Sep 16 17:39:28 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-37c8dc60-6e2b-40c1-bf6e-3b2f72bd33e2 tempest-GroupsTest-814532688 None] Created volume successfully. Sep 16 17:39:28 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-988bea17-06de-4754-89cb-35507cc454fe req-d26468b5-a12d-4616-8d85-b1dda1aed3c8 tempest-ServerActionsTestOtherA-1725898912 None] attachment_update completed successfully. Sep 16 17:39:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-8a6ae94c-cc7a-4ce9-ac10-2853a1048fb3 req-17dd2e00-8030-437a-8373-299c1533c33f tempest-AttachVolumeNegativeTest-195502489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-8a6ae94c-cc7a-4ce9-ac10-2853a1048fb3 req-17dd2e00-8030-437a-8373-299c1533c33f tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-8a6ae94c-cc7a-4ce9-ac10-2853a1048fb3 req-17dd2e00-8030-437a-8373-299c1533c33f tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-8a6ae94c-cc7a-4ce9-ac10-2853a1048fb3 req-17dd2e00-8030-437a-8373-299c1533c33f tempest-AttachVolumeNegativeTest-195502489 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7', 'name': 'volume-871867ef-d231-4ff1-9a0c-9a19140c2c80', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0c79e9b3-4e5f-45a8-9a34-1e91a3477b8e', 'enforce_multipath': True} {{(pid=85899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4920}} Sep 16 17:39:29 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-8a6ae94c-cc7a-4ce9-ac10-2853a1048fb3 req-17dd2e00-8030-437a-8373-299c1533c33f tempest-AttachVolumeNegativeTest-195502489 None] attachment_update completed successfully. Sep 16 17:39:29 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:39:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Flow 'volume_create_manager' (bc04f997-69fb-4666-ba10-4bdaf98f3517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:39:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7344c113-e9ef-4193-8ec7-86e8db02c67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7344c113-e9ef-4193-8ec7-86e8db02c67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1812721846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6d5868d-698c-4b6d-a24d-2c4efa7b1bdc,host='devstack@QuobyteHD#QuobyteHD',id=94db4a53-caf6-4730-94b8-4d37179aec0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec69ecfd39c749808eb4d1d935191c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:39:30Z,use_quota=True,user_id='f4b3763b2f6f460e9391a6c9c86de347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7643624d-cd29-4bd7-b36d-52deb1bd9bb0),volume_type_id=7643624d-cd29-4bd7-b36d-52deb1bd9bb0)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f28c1d38-275d-4c0d-b12c-ea5dc959c561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f28c1d38-275d-4c0d-b12c-ea5dc959c561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8286e6dd-926d-4392-97e9-af1e0a6ebab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8286e6dd-926d-4392-97e9-af1e0a6ebab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94db4a53-caf6-4730-94b8-4d37179aec0d', 'volume_name': 'volume-94db4a53-caf6-4730-94b8-4d37179aec0d', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53d7727-e890-4c9e-bcec-d1c714c2fdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53d7727-e890-4c9e-bcec-d1c714c2fdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ec124e-0e03-46b0-9d60-d8c30f2cd678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:30 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Volume 94db4a53-caf6-4730-94b8-4d37179aec0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94db4a53-caf6-4730-94b8-4d37179aec0d', 'volume_size': 1} Sep 16 17:39:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c6d5868d-698c-4b6d-a24d-2c4efa7b1bdc,created_at=2026-09-16T15:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1812721846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6d5868d-698c-4b6d-a24d-2c4efa7b1bdc,host='devstack@QuobyteHD#QuobyteHD',id=94db4a53-caf6-4730-94b8-4d37179aec0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec69ecfd39c749808eb4d1d935191c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:39:30Z,use_quota=True,user_id='f4b3763b2f6f460e9391a6c9c86de347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7643624d-cd29-4bd7-b36d-52deb1bd9bb0),volume_type_id=7643624d-cd29-4bd7-b36d-52deb1bd9bb0)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:39:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Creating volume 94db4a53-caf6-4730-94b8-4d37179aec0d {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:39:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:39:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:39:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:39:30 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:39:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-94db4a53-caf6-4730-94b8-4d37179aec0d 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:30 devstack sudo[91223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-94db4a53-caf6-4730-94b8-4d37179aec0d 1073741824 Sep 16 17:39:30 devstack sudo[91223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:30 devstack sudo[91223]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-94db4a53-caf6-4730-94b8-4d37179aec0d 1073741824" returned: 0 in 0.582s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-94db4a53-caf6-4730-94b8-4d37179aec0d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:30 devstack sudo[91237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-94db4a53-caf6-4730-94b8-4d37179aec0d Sep 16 17:39:30 devstack sudo[91237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:31 devstack sudo[91237]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-94db4a53-caf6-4730-94b8-4d37179aec0d" returned: 0 in 0.415s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:31 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:39:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:31 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ec124e-0e03-46b0-9d60-d8c30f2cd678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94db4a53-caf6-4730-94b8-4d37179aec0d', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:31 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e8a14e-9790-4e2b-9d43-a855d87db0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:31 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Volume volume-94db4a53-caf6-4730-94b8-4d37179aec0d (94db4a53-caf6-4730-94b8-4d37179aec0d): created successfully Sep 16 17:39:31 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e8a14e-9790-4e2b-9d43-a855d87db0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:31 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Flow 'volume_create_manager' (bc04f997-69fb-4666-ba10-4bdaf98f3517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:39:31 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-40aa5d4b-db06-4b56-bb68-ecd60f3cc1e5 tempest-GroupsTest-814532688 None] Created volume successfully. Sep 16 17:39:33 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-2888a58a-a137-467c-9acf-1465c14f7b2a tempest-GroupsTest-814532688 None] Update group completed successfully. Sep 16 17:39:35 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-02b34f16-e641-4867-812c-b511be6f0736 tempest-GroupsTest-814532688 None] Update group completed successfully. Sep 16 17:39:35 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:39:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Flow 'volume_create_manager' (b9053304-6c39-4289-902c-b811da13ea98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:39:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7618ab-6e93-4571-948c-13fd982777ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7618ab-6e93-4571-948c-13fd982777ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1515190925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42e29d9-c510-41ec-908e-ca91daa4f890,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ffd508f46424533b0f448e7ca5e5d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:39:35Z,use_quota=True,user_id='1d08d43d01a24d9899774d339b471688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6929f901-d7ba-4af4-9e94-08c49d6eef9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6929f901-d7ba-4af4-9e94-08c49d6eef9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f198422a-42cc-4380-bf43-9043881e2c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f198422a-42cc-4380-bf43-9043881e2c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f42e29d9-c510-41ec-908e-ca91daa4f890', 'volume_name': 'volume-f42e29d9-c510-41ec-908e-ca91daa4f890', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2dc5d6a-76e5-4779-9cbd-92b9242de7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2dc5d6a-76e5-4779-9cbd-92b9242de7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac4ad7dd-4e25-4064-b1e2-02197fcd27c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:35 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Volume f42e29d9-c510-41ec-908e-ca91daa4f890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f42e29d9-c510-41ec-908e-ca91daa4f890', 'volume_size': 1} Sep 16 17:39:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1515190925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42e29d9-c510-41ec-908e-ca91daa4f890,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ffd508f46424533b0f448e7ca5e5d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:39:35Z,use_quota=True,user_id='1d08d43d01a24d9899774d339b471688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:39:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Creating volume f42e29d9-c510-41ec-908e-ca91daa4f890 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:39:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:39:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:39:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:39:35 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:39:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f42e29d9-c510-41ec-908e-ca91daa4f890 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:35 devstack sudo[91280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f42e29d9-c510-41ec-908e-ca91daa4f890 1073741824 Sep 16 17:39:35 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:36 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f42e29d9-c510-41ec-908e-ca91daa4f890 1073741824" returned: 0 in 0.572s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f42e29d9-c510-41ec-908e-ca91daa4f890 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:36 devstack sudo[91286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f42e29d9-c510-41ec-908e-ca91daa4f890 Sep 16 17:39:36 devstack sudo[91286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:36 devstack sudo[91286]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f42e29d9-c510-41ec-908e-ca91daa4f890" returned: 0 in 0.448s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:36 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:39:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac4ad7dd-4e25-4064-b1e2-02197fcd27c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f42e29d9-c510-41ec-908e-ca91daa4f890', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ef35e2-8497-4a42-8b9f-9a0e2bd7150e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:36 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Volume volume-f42e29d9-c510-41ec-908e-ca91daa4f890 (f42e29d9-c510-41ec-908e-ca91daa4f890): created successfully Sep 16 17:39:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ef35e2-8497-4a42-8b9f-9a0e2bd7150e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Flow 'volume_create_manager' (b9053304-6c39-4289-902c-b811da13ea98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:39:36 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-f6f55988-9d4f-4aba-9983-dcc133cbc0c4 req-59ed78e9-55c5-48a5-b81b-d145de6a34c7 tempest-VolumesGetTestJSON-1613409026 None] Created volume successfully. Sep 16 17:39:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] Acquiring lock "cinder-quobyte-94db4a53-caf6-4730-94b8-4d37179aec0d" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:39:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] Lock "cinder-quobyte-94db4a53-caf6-4730-94b8-4d37179aec0d" acquired by "delete_volume" :: waited 0.049s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:39:37 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[34522fb0-22a6-4cf3-857b-7ad5eca51b8c]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:39:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-94db4a53-caf6-4730-94b8-4d37179aec0d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:37 devstack sudo[91294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-94db4a53-caf6-4730-94b8-4d37179aec0d Sep 16 17:39:37 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-7a1e73d0-d5cc-4ade-8780-3ec72553dada req-1629d40c-267c-4b4f-a62c-a44d3bc69dea tempest-VolumesGetTestJSON-1613409026 None] Acquiring lock "cinder-f42e29d9-c510-41ec-908e-ca91daa4f890-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:39:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-7a1e73d0-d5cc-4ade-8780-3ec72553dada req-1629d40c-267c-4b4f-a62c-a44d3bc69dea tempest-VolumesGetTestJSON-1613409026 None] Lock "cinder-f42e29d9-c510-41ec-908e-ca91daa4f890-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:39:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-7a1e73d0-d5cc-4ade-8780-3ec72553dada req-1629d40c-267c-4b4f-a62c-a44d3bc69dea tempest-VolumesGetTestJSON-1613409026 None] Acquiring lock "cinder-quobyte-f42e29d9-c510-41ec-908e-ca91daa4f890" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:39:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-7a1e73d0-d5cc-4ade-8780-3ec72553dada req-1629d40c-267c-4b4f-a62c-a44d3bc69dea tempest-VolumesGetTestJSON-1613409026 None] Lock "cinder-quobyte-f42e29d9-c510-41ec-908e-ca91daa4f890" acquired by "delete_volume" :: waited 0.043s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:39:38 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[430f7c62-fa2e-48ff-9c3e-47d03f826c9e]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:39:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-7a1e73d0-d5cc-4ade-8780-3ec72553dada req-1629d40c-267c-4b4f-a62c-a44d3bc69dea tempest-VolumesGetTestJSON-1613409026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f42e29d9-c510-41ec-908e-ca91daa4f890 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:38 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-94db4a53-caf6-4730-94b8-4d37179aec0d" returned: 0 in 0.684s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-94db4a53-caf6-4730-94b8-4d37179aec0d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:38 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-94db4a53-caf6-4730-94b8-4d37179aec0d Sep 16 17:39:38 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:38 devstack sudo[91299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f42e29d9-c510-41ec-908e-ca91daa4f890 Sep 16 17:39:38 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:38 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-94db4a53-caf6-4730-94b8-4d37179aec0d" returned: 0 in 0.342s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] Lock "cinder-quobyte-94db4a53-caf6-4730-94b8-4d37179aec0d" released by "delete_volume" :: held 1.154s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:39:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] Acquiring lock "cinder-quobyte-eb1d906a-a8fe-437a-a626-552936894986" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:39:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] Lock "cinder-quobyte-eb1d906a-a8fe-437a-a626-552936894986" acquired by "delete_volume" :: waited 0.038s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:39:38 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaac6c9-465e-439d-b717-2a136e7f348c]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:39:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eb1d906a-a8fe-437a-a626-552936894986 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:38 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-7a1e73d0-d5cc-4ade-8780-3ec72553dada req-1629d40c-267c-4b4f-a62c-a44d3bc69dea tempest-VolumesGetTestJSON-1613409026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f42e29d9-c510-41ec-908e-ca91daa4f890" returned: 0 in 0.648s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-7a1e73d0-d5cc-4ade-8780-3ec72553dada req-1629d40c-267c-4b4f-a62c-a44d3bc69dea tempest-VolumesGetTestJSON-1613409026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f42e29d9-c510-41ec-908e-ca91daa4f890 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:38 devstack sudo[91307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eb1d906a-a8fe-437a-a626-552936894986 Sep 16 17:39:38 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:38 devstack sudo[91308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f42e29d9-c510-41ec-908e-ca91daa4f890 Sep 16 17:39:38 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:39 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eb1d906a-a8fe-437a-a626-552936894986" returned: 0 in 0.583s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eb1d906a-a8fe-437a-a626-552936894986 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:39 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-7a1e73d0-d5cc-4ade-8780-3ec72553dada req-1629d40c-267c-4b4f-a62c-a44d3bc69dea tempest-VolumesGetTestJSON-1613409026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f42e29d9-c510-41ec-908e-ca91daa4f890" returned: 0 in 0.514s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:39 devstack sudo[91319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eb1d906a-a8fe-437a-a626-552936894986 Sep 16 17:39:39 devstack sudo[91319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-7a1e73d0-d5cc-4ade-8780-3ec72553dada req-1629d40c-267c-4b4f-a62c-a44d3bc69dea tempest-VolumesGetTestJSON-1613409026 None] Lock "cinder-quobyte-f42e29d9-c510-41ec-908e-ca91daa4f890" released by "delete_volume" :: held 1.237s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:39:39 devstack cinder-volume[85899]: DEBUG cinder.quota [req-7a1e73d0-d5cc-4ade-8780-3ec72553dada req-1629d40c-267c-4b4f-a62c-a44d3bc69dea tempest-VolumesGetTestJSON-1613409026 None] Created reservations ['3140d167-8479-4302-b105-1713d5caca43', '3fff1dd0-221e-4845-a183-4c272138c177', 'f6a35759-50de-4f65-8526-33f101a9fd0f', '496ea8f3-f750-4320-8b56-336a10d93362'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:39:39 devstack sudo[91319]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eb1d906a-a8fe-437a-a626-552936894986" returned: 0 in 0.311s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-7a1e73d0-d5cc-4ade-8780-3ec72553dada req-1629d40c-267c-4b4f-a62c-a44d3bc69dea tempest-VolumesGetTestJSON-1613409026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-7a1e73d0-d5cc-4ade-8780-3ec72553dada req-1629d40c-267c-4b4f-a62c-a44d3bc69dea tempest-VolumesGetTestJSON-1613409026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [req-7a1e73d0-d5cc-4ade-8780-3ec72553dada req-1629d40c-267c-4b4f-a62c-a44d3bc69dea tempest-VolumesGetTestJSON-1613409026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:39:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [req-7a1e73d0-d5cc-4ade-8780-3ec72553dada req-1629d40c-267c-4b4f-a62c-a44d3bc69dea tempest-VolumesGetTestJSON-1613409026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:39:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-7a1e73d0-d5cc-4ade-8780-3ec72553dada req-1629d40c-267c-4b4f-a62c-a44d3bc69dea tempest-VolumesGetTestJSON-1613409026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-7a1e73d0-d5cc-4ade-8780-3ec72553dada req-1629d40c-267c-4b4f-a62c-a44d3bc69dea tempest-VolumesGetTestJSON-1613409026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] Lock "cinder-quobyte-eb1d906a-a8fe-437a-a626-552936894986" released by "delete_volume" :: held 1.013s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:39:39 devstack sudo[91328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:39:39 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:39 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] Created reservations ['cf49ec30-d8ff-4c1a-aedf-8f47b4412683'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:39:39 devstack cinder-volume[85899]: WARNING cinder.quota [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1255275815 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1255275815, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:39:39 devstack cinder-volume[85899]: WARNING cinder.quota [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1255275815 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1255275815, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:39:39 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] Created reservations ['9e59fedd-2065-4f51-89e8-7088d124f08e', 'd2a96cc5-d617-4d2e-b0ae-52d9a0243eab', '98236639-19a1-4d77-a097-25db2997686c', '2af52231-6dfa-4478-8662-6dde3e79fcb7'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:39:40 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-7a1e73d0-d5cc-4ade-8780-3ec72553dada req-1629d40c-267c-4b4f-a62c-a44d3bc69dea tempest-VolumesGetTestJSON-1613409026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.400s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:40 devstack cinder-volume[85899]: DEBUG cinder.manager [req-7a1e73d0-d5cc-4ade-8780-3ec72553dada req-1629d40c-267c-4b4f-a62c-a44d3bc69dea tempest-VolumesGetTestJSON-1613409026 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:39:40 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-7a1e73d0-d5cc-4ade-8780-3ec72553dada req-1629d40c-267c-4b4f-a62c-a44d3bc69dea tempest-VolumesGetTestJSON-1613409026 None] Deleted volume successfully. Sep 16 17:39:40 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-7a1e73d0-d5cc-4ade-8780-3ec72553dada req-1629d40c-267c-4b4f-a62c-a44d3bc69dea tempest-VolumesGetTestJSON-1613409026 None] Lock "cinder-f42e29d9-c510-41ec-908e-ca91daa4f890-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:39:40 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] Created reservations ['d0ea32f9-56b1-4ec7-8e5d-54c509539b23', '664c3cd4-e9e9-4170-8925-e3dfe5769e39', 'f2278166-70aa-4501-bdc0-985e1746322b', '5a3d7820-d276-466b-b94c-42571c101b67'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:39:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:39:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:39:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:40 devstack sudo[91337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:39:40 devstack sudo[91337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:40 devstack sudo[91337]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.486s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:40 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:39:40 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-3fe932ac-9be5-4812-a6b8-4f8860c94219 tempest-GroupsTest-814532688 None] Delete group completed successfully. Sep 16 17:39:48 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:39:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Flow 'volume_create_manager' (1bffcab9-4d4c-4ca1-a658-2432c4dad197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:39:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf1dda5-c030-4053-b2a1-f3bbc495c225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf1dda5-c030-4053-b2a1-f3bbc495c225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1713630648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=325a8701-720d-4d09-9288-011d53d332ff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='24b7ade2739d436d8d7f73f659428f54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:39:48Z,use_quota=True,user_id='6cf3ae0db7844847b0e5ee6e5d9e6163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c8f004-e4c4-4ad0-aeee-3ca15eb6b5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c8f004-e4c4-4ad0-aeee-3ca15eb6b5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cceb51a3-85ca-4334-b87c-89b479c07390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cceb51a3-85ca-4334-b87c-89b479c07390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '325a8701-720d-4d09-9288-011d53d332ff', 'volume_name': 'volume-325a8701-720d-4d09-9288-011d53d332ff', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8039f1e0-d33f-4d93-9158-3d9834783ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8039f1e0-d33f-4d93-9158-3d9834783ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eabe1ee-ff02-4679-9801-26d3684c2b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:48 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Volume 325a8701-720d-4d09-9288-011d53d332ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-325a8701-720d-4d09-9288-011d53d332ff', 'volume_size': 1} Sep 16 17:39:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1713630648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=325a8701-720d-4d09-9288-011d53d332ff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='24b7ade2739d436d8d7f73f659428f54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:39:48Z,use_quota=True,user_id='6cf3ae0db7844847b0e5ee6e5d9e6163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:39:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Creating volume 325a8701-720d-4d09-9288-011d53d332ff {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:39:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:39:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:39:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:39:48 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:39:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-325a8701-720d-4d09-9288-011d53d332ff 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:48 devstack sudo[91391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-325a8701-720d-4d09-9288-011d53d332ff 1073741824 Sep 16 17:39:48 devstack sudo[91391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:49 devstack sudo[91391]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-325a8701-720d-4d09-9288-011d53d332ff 1073741824" returned: 0 in 0.854s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-325a8701-720d-4d09-9288-011d53d332ff {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:49 devstack sudo[91424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-325a8701-720d-4d09-9288-011d53d332ff Sep 16 17:39:49 devstack sudo[91424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:49 devstack sudo[91424]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-325a8701-720d-4d09-9288-011d53d332ff" returned: 0 in 0.470s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:39:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eabe1ee-ff02-4679-9801-26d3684c2b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-325a8701-720d-4d09-9288-011d53d332ff', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da57130-7d00-4e35-bcbb-d1787fb96069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:49 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Volume volume-325a8701-720d-4d09-9288-011d53d332ff (325a8701-720d-4d09-9288-011d53d332ff): created successfully Sep 16 17:39:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da57130-7d00-4e35-bcbb-d1787fb96069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Flow 'volume_create_manager' (1bffcab9-4d4c-4ca1-a658-2432c4dad197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:39:49 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-e97a02c7-a103-4143-a027-4b2c756ad4f5 tempest-VolumesTestJSON-429106789 None] Created volume successfully. Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Flow 'volume_create_manager' (703119e8-54f6-4df2-9a6c-f67b89a4dcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035904be-9146-4e05-8014-2f3d034cdd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035904be-9146-4e05-8014-2f3d034cdd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1915352495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da51a279-56d1-4c48-96bd-23a0a0e3c1f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='24b7ade2739d436d8d7f73f659428f54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:39:51Z,use_quota=True,user_id='6cf3ae0db7844847b0e5ee6e5d9e6163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4080f667-a2d8-4ffd-a160-4a4cdfb3e013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4080f667-a2d8-4ffd-a160-4a4cdfb3e013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22277f5c-23c9-4472-bd2f-d315475a48fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22277f5c-23c9-4472-bd2f-d315475a48fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da51a279-56d1-4c48-96bd-23a0a0e3c1f1', 'volume_name': 'volume-da51a279-56d1-4c48-96bd-23a0a0e3c1f1', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74cad4d0-68bb-4332-bb6b-7a64933ec8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74cad4d0-68bb-4332-bb6b-7a64933ec8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6832ce4-b5db-45af-80d1-fb7986bce674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:51 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Volume da51a279-56d1-4c48-96bd-23a0a0e3c1f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da51a279-56d1-4c48-96bd-23a0a0e3c1f1', 'volume_size': 1} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1915352495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da51a279-56d1-4c48-96bd-23a0a0e3c1f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='24b7ade2739d436d8d7f73f659428f54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:39:51Z,use_quota=True,user_id='6cf3ae0db7844847b0e5ee6e5d9e6163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Creating volume da51a279-56d1-4c48-96bd-23a0a0e3c1f1 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:39:51 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-da51a279-56d1-4c48-96bd-23a0a0e3c1f1 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:51 devstack sudo[91441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-da51a279-56d1-4c48-96bd-23a0a0e3c1f1 1073741824 Sep 16 17:39:51 devstack sudo[91441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:51 devstack sudo[91441]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-da51a279-56d1-4c48-96bd-23a0a0e3c1f1 1073741824" returned: 0 in 0.483s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-da51a279-56d1-4c48-96bd-23a0a0e3c1f1 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:51 devstack sudo[91448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-da51a279-56d1-4c48-96bd-23a0a0e3c1f1 Sep 16 17:39:51 devstack sudo[91448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:51 devstack sudo[91448]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-da51a279-56d1-4c48-96bd-23a0a0e3c1f1" returned: 0 in 0.261s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6832ce4-b5db-45af-80d1-fb7986bce674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da51a279-56d1-4c48-96bd-23a0a0e3c1f1', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d04ae4-2a2c-4dd3-9276-f6d27b8c6f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:51 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Volume volume-da51a279-56d1-4c48-96bd-23a0a0e3c1f1 (da51a279-56d1-4c48-96bd-23a0a0e3c1f1): created successfully Sep 16 17:39:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d04ae4-2a2c-4dd3-9276-f6d27b8c6f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Flow 'volume_create_manager' (703119e8-54f6-4df2-9a6c-f67b89a4dcdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:39:52 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-6a3bdefb-e6dd-450a-92d6-7b698d7ca703 tempest-VolumesTestJSON-429106789 None] Created volume successfully. Sep 16 17:39:52 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-cedb9e20-6ce1-47d3-abb0-ba1690710e4e tempest-GroupsV320Test-1669535465 None] Group tempest-GroupsV320Test-Group-520080912: creating Sep 16 17:39:52 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-cedb9e20-6ce1-47d3-abb0-ba1690710e4e tempest-GroupsV320Test-1669535465 None] Group tempest-GroupsV320Test-Group-520080912: created successfully Sep 16 17:39:52 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-cedb9e20-6ce1-47d3-abb0-ba1690710e4e tempest-GroupsV320Test-1669535465 None] Create group completed successfully. Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Flow 'volume_create_manager' (8021eb99-d5d2-4eea-8621-596c30066638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1deb6015-023d-4d80-a819-cddddceab4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1deb6015-023d-4d80-a819-cddddceab4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-956246970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03fa531-8e01-463c-9ad2-205db37dd2ae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='24b7ade2739d436d8d7f73f659428f54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:39:54Z,use_quota=True,user_id='6cf3ae0db7844847b0e5ee6e5d9e6163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c12916-b48e-42f3-b2ff-68e6660e61c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c12916-b48e-42f3-b2ff-68e6660e61c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0c602a-4ffe-44aa-8ef3-877ed7b9bdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0c602a-4ffe-44aa-8ef3-877ed7b9bdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f03fa531-8e01-463c-9ad2-205db37dd2ae', 'volume_name': 'volume-f03fa531-8e01-463c-9ad2-205db37dd2ae', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb18f4c-3c5d-4237-b5f2-5d5159c44b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb18f4c-3c5d-4237-b5f2-5d5159c44b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00dd0b11-871c-4fe4-b032-41f8253b442e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:53 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Volume f03fa531-8e01-463c-9ad2-205db37dd2ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f03fa531-8e01-463c-9ad2-205db37dd2ae', 'volume_size': 1} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-956246970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03fa531-8e01-463c-9ad2-205db37dd2ae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='24b7ade2739d436d8d7f73f659428f54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:39:54Z,use_quota=True,user_id='6cf3ae0db7844847b0e5ee6e5d9e6163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Creating volume f03fa531-8e01-463c-9ad2-205db37dd2ae {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:39:53 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f03fa531-8e01-463c-9ad2-205db37dd2ae 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:53 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f03fa531-8e01-463c-9ad2-205db37dd2ae 1073741824 Sep 16 17:39:53 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-2ff1bb45-3c53-48cd-99cb-7a2d11f6ced5 tempest-GroupsV320Test-1669535465 None] Created reservations ['d81aa1ce-d9a2-457c-a020-5cb8d62b6f3a'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2ff1bb45-3c53-48cd-99cb-7a2d11f6ced5 tempest-GroupsV320Test-1669535465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2ff1bb45-3c53-48cd-99cb-7a2d11f6ced5 tempest-GroupsV320Test-1669535465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2ff1bb45-3c53-48cd-99cb-7a2d11f6ced5 tempest-GroupsV320Test-1669535465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2ff1bb45-3c53-48cd-99cb-7a2d11f6ced5 tempest-GroupsV320Test-1669535465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2ff1bb45-3c53-48cd-99cb-7a2d11f6ced5 tempest-GroupsV320Test-1669535465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2ff1bb45-3c53-48cd-99cb-7a2d11f6ced5 tempest-GroupsV320Test-1669535465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:54 devstack sudo[91453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:39:54 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:54 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f03fa531-8e01-463c-9ad2-205db37dd2ae 1073741824" returned: 0 in 0.448s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:54 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2ff1bb45-3c53-48cd-99cb-7a2d11f6ced5 tempest-GroupsV320Test-1669535465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.272s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:54 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-2ff1bb45-3c53-48cd-99cb-7a2d11f6ced5 tempest-GroupsV320Test-1669535465 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:39:54 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-2ff1bb45-3c53-48cd-99cb-7a2d11f6ced5 tempest-GroupsV320Test-1669535465 None] Delete group completed successfully. Sep 16 17:39:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f03fa531-8e01-463c-9ad2-205db37dd2ae {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:54 devstack sudo[91461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f03fa531-8e01-463c-9ad2-205db37dd2ae Sep 16 17:39:54 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:54 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f03fa531-8e01-463c-9ad2-205db37dd2ae" returned: 0 in 0.249s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:54 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:39:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00dd0b11-871c-4fe4-b032-41f8253b442e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03fa531-8e01-463c-9ad2-205db37dd2ae', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e0e360-4734-4848-8757-df922af92465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:39:54 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Volume volume-f03fa531-8e01-463c-9ad2-205db37dd2ae (f03fa531-8e01-463c-9ad2-205db37dd2ae): created successfully Sep 16 17:39:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e0e360-4734-4848-8757-df922af92465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:39:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Flow 'volume_create_manager' (8021eb99-d5d2-4eea-8621-596c30066638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:39:54 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-11fe0d6b-beb6-452b-929a-4c508e6ccf3c tempest-VolumesTestJSON-429106789 None] Created volume successfully. Sep 16 17:39:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ad6862a0-08c8-4728-adf0-6b8fea1cdc68 tempest-VolumesTestJSON-429106789 None] Acquiring lock "cinder-f03fa531-8e01-463c-9ad2-205db37dd2ae-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:39:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ad6862a0-08c8-4728-adf0-6b8fea1cdc68 tempest-VolumesTestJSON-429106789 None] Lock "cinder-f03fa531-8e01-463c-9ad2-205db37dd2ae-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:39:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ad6862a0-08c8-4728-adf0-6b8fea1cdc68 tempest-VolumesTestJSON-429106789 None] Acquiring lock "cinder-quobyte-f03fa531-8e01-463c-9ad2-205db37dd2ae" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:39:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ad6862a0-08c8-4728-adf0-6b8fea1cdc68 tempest-VolumesTestJSON-429106789 None] Lock "cinder-quobyte-f03fa531-8e01-463c-9ad2-205db37dd2ae" acquired by "delete_volume" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:39:57 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa1629a-eb87-4a28-b393-0c85b8f15338]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:39:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad6862a0-08c8-4728-adf0-6b8fea1cdc68 tempest-VolumesTestJSON-429106789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f03fa531-8e01-463c-9ad2-205db37dd2ae {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:57 devstack sudo[91464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f03fa531-8e01-463c-9ad2-205db37dd2ae Sep 16 17:39:57 devstack sudo[91464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:57 devstack sudo[91464]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad6862a0-08c8-4728-adf0-6b8fea1cdc68 tempest-VolumesTestJSON-429106789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f03fa531-8e01-463c-9ad2-205db37dd2ae" returned: 0 in 0.484s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad6862a0-08c8-4728-adf0-6b8fea1cdc68 tempest-VolumesTestJSON-429106789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f03fa531-8e01-463c-9ad2-205db37dd2ae {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:57 devstack sudo[91470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f03fa531-8e01-463c-9ad2-205db37dd2ae Sep 16 17:39:57 devstack sudo[91470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:57 devstack sudo[91470]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad6862a0-08c8-4728-adf0-6b8fea1cdc68 tempest-VolumesTestJSON-429106789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f03fa531-8e01-463c-9ad2-205db37dd2ae" returned: 0 in 0.358s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ad6862a0-08c8-4728-adf0-6b8fea1cdc68 tempest-VolumesTestJSON-429106789 None] Lock "cinder-quobyte-f03fa531-8e01-463c-9ad2-205db37dd2ae" released by "delete_volume" :: held 0.906s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:39:58 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-ad6862a0-08c8-4728-adf0-6b8fea1cdc68 tempest-VolumesTestJSON-429106789 None] Created reservations ['70d586cf-8bc5-4dae-be61-7ebc9cd44795', '7b71de47-0e90-4f23-91cb-1577a055d06b', '9d0a4d36-433b-47cf-a071-9cee06053c48', 'b505e698-ae30-4b6c-b28f-26982a78e32c'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:39:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ad6862a0-08c8-4728-adf0-6b8fea1cdc68 tempest-VolumesTestJSON-429106789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ad6862a0-08c8-4728-adf0-6b8fea1cdc68 tempest-VolumesTestJSON-429106789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:58 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ad6862a0-08c8-4728-adf0-6b8fea1cdc68 tempest-VolumesTestJSON-429106789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:39:58 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ad6862a0-08c8-4728-adf0-6b8fea1cdc68 tempest-VolumesTestJSON-429106789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:39:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ad6862a0-08c8-4728-adf0-6b8fea1cdc68 tempest-VolumesTestJSON-429106789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad6862a0-08c8-4728-adf0-6b8fea1cdc68 tempest-VolumesTestJSON-429106789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:58 devstack sudo[91473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:39:58 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d60ad84b-a588-4932-9ba7-7f3231b8e222 tempest-VolumesTestJSON-429106789 None] Acquiring lock "cinder-da51a279-56d1-4c48-96bd-23a0a0e3c1f1-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:39:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d60ad84b-a588-4932-9ba7-7f3231b8e222 tempest-VolumesTestJSON-429106789 None] Lock "cinder-da51a279-56d1-4c48-96bd-23a0a0e3c1f1-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:39:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d60ad84b-a588-4932-9ba7-7f3231b8e222 tempest-VolumesTestJSON-429106789 None] Acquiring lock "cinder-quobyte-da51a279-56d1-4c48-96bd-23a0a0e3c1f1" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:39:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d60ad84b-a588-4932-9ba7-7f3231b8e222 tempest-VolumesTestJSON-429106789 None] Lock "cinder-quobyte-da51a279-56d1-4c48-96bd-23a0a0e3c1f1" acquired by "delete_volume" :: waited 0.045s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:39:58 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b033bf-87f8-4b23-892b-a17c7b3681f9]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:39:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d60ad84b-a588-4932-9ba7-7f3231b8e222 tempest-VolumesTestJSON-429106789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-da51a279-56d1-4c48-96bd-23a0a0e3c1f1 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:58 devstack sudo[91475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-da51a279-56d1-4c48-96bd-23a0a0e3c1f1 Sep 16 17:39:58 devstack sudo[91475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:58 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad6862a0-08c8-4728-adf0-6b8fea1cdc68 tempest-VolumesTestJSON-429106789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.687s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:58 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-ad6862a0-08c8-4728-adf0-6b8fea1cdc68 tempest-VolumesTestJSON-429106789 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:39:58 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-ad6862a0-08c8-4728-adf0-6b8fea1cdc68 tempest-VolumesTestJSON-429106789 None] Deleted volume successfully. Sep 16 17:39:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ad6862a0-08c8-4728-adf0-6b8fea1cdc68 tempest-VolumesTestJSON-429106789 None] Lock "cinder-f03fa531-8e01-463c-9ad2-205db37dd2ae-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:39:59 devstack sudo[91475]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d60ad84b-a588-4932-9ba7-7f3231b8e222 tempest-VolumesTestJSON-429106789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-da51a279-56d1-4c48-96bd-23a0a0e3c1f1" returned: 0 in 0.574s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d60ad84b-a588-4932-9ba7-7f3231b8e222 tempest-VolumesTestJSON-429106789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-da51a279-56d1-4c48-96bd-23a0a0e3c1f1 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:59 devstack sudo[91481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-da51a279-56d1-4c48-96bd-23a0a0e3c1f1 Sep 16 17:39:59 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:39:59 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root Sep 16 17:39:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d60ad84b-a588-4932-9ba7-7f3231b8e222 tempest-VolumesTestJSON-429106789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-da51a279-56d1-4c48-96bd-23a0a0e3c1f1" returned: 0 in 0.374s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:39:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d60ad84b-a588-4932-9ba7-7f3231b8e222 tempest-VolumesTestJSON-429106789 None] Lock "cinder-quobyte-da51a279-56d1-4c48-96bd-23a0a0e3c1f1" released by "delete_volume" :: held 1.040s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:39:59 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-d60ad84b-a588-4932-9ba7-7f3231b8e222 tempest-VolumesTestJSON-429106789 None] Created reservations ['6810a845-ff8c-4dce-9e90-5598edfda0cd', '1722535b-9bb0-49db-9c90-d9f8949e30e9', 'dfd36749-d9d3-4d0c-adbc-49128f7362fe', 'ad96e1a1-403f-4908-a3de-29952f078b13'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:39:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d60ad84b-a588-4932-9ba7-7f3231b8e222 tempest-VolumesTestJSON-429106789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:39:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d60ad84b-a588-4932-9ba7-7f3231b8e222 tempest-VolumesTestJSON-429106789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:39:59 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d60ad84b-a588-4932-9ba7-7f3231b8e222 tempest-VolumesTestJSON-429106789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:39:59 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d60ad84b-a588-4932-9ba7-7f3231b8e222 tempest-VolumesTestJSON-429106789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:39:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d60ad84b-a588-4932-9ba7-7f3231b8e222 tempest-VolumesTestJSON-429106789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:39:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d60ad84b-a588-4932-9ba7-7f3231b8e222 tempest-VolumesTestJSON-429106789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:39:59 devstack sudo[91518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:39:59 devstack sudo[91518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:00 devstack sudo[91518]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d60ad84b-a588-4932-9ba7-7f3231b8e222 tempest-VolumesTestJSON-429106789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.273s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:00 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-d60ad84b-a588-4932-9ba7-7f3231b8e222 tempest-VolumesTestJSON-429106789 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:40:00 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-d60ad84b-a588-4932-9ba7-7f3231b8e222 tempest-VolumesTestJSON-429106789 None] Deleted volume successfully. Sep 16 17:40:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d60ad84b-a588-4932-9ba7-7f3231b8e222 tempest-VolumesTestJSON-429106789 None] Lock "cinder-da51a279-56d1-4c48-96bd-23a0a0e3c1f1-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a7290038-5bc2-44f5-bfca-7030ca7d28ef tempest-VolumesTestJSON-429106789 None] Acquiring lock "cinder-325a8701-720d-4d09-9288-011d53d332ff-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:40:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a7290038-5bc2-44f5-bfca-7030ca7d28ef tempest-VolumesTestJSON-429106789 None] Lock "cinder-325a8701-720d-4d09-9288-011d53d332ff-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:40:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a7290038-5bc2-44f5-bfca-7030ca7d28ef tempest-VolumesTestJSON-429106789 None] Acquiring lock "cinder-quobyte-325a8701-720d-4d09-9288-011d53d332ff" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:40:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a7290038-5bc2-44f5-bfca-7030ca7d28ef tempest-VolumesTestJSON-429106789 None] Lock "cinder-quobyte-325a8701-720d-4d09-9288-011d53d332ff" acquired by "delete_volume" :: waited 0.022s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:40:00 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6dc8de-cbc8-4fa0-9af6-bf8449959bcf]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:40:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a7290038-5bc2-44f5-bfca-7030ca7d28ef tempest-VolumesTestJSON-429106789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-325a8701-720d-4d09-9288-011d53d332ff {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:00 devstack sudo[91528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-325a8701-720d-4d09-9288-011d53d332ff Sep 16 17:40:00 devstack sudo[91528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:01 devstack sudo[91528]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a7290038-5bc2-44f5-bfca-7030ca7d28ef tempest-VolumesTestJSON-429106789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-325a8701-720d-4d09-9288-011d53d332ff" returned: 0 in 0.387s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a7290038-5bc2-44f5-bfca-7030ca7d28ef tempest-VolumesTestJSON-429106789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-325a8701-720d-4d09-9288-011d53d332ff {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:01 devstack sudo[91533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-325a8701-720d-4d09-9288-011d53d332ff Sep 16 17:40:01 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:01 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a7290038-5bc2-44f5-bfca-7030ca7d28ef tempest-VolumesTestJSON-429106789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-325a8701-720d-4d09-9288-011d53d332ff" returned: 0 in 0.260s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a7290038-5bc2-44f5-bfca-7030ca7d28ef tempest-VolumesTestJSON-429106789 None] Lock "cinder-quobyte-325a8701-720d-4d09-9288-011d53d332ff" released by "delete_volume" :: held 0.706s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:01 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-a7290038-5bc2-44f5-bfca-7030ca7d28ef tempest-VolumesTestJSON-429106789 None] Created reservations ['7ccee9f5-4501-4c4f-99fb-22d2b497bac3', '5aab9378-d082-402d-a097-52eb8cd81665', '0f2fceb3-9580-4dcc-a7b0-87d69d110aab', '09dbd59f-e29c-4886-86c6-49869aa86368'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:40:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a7290038-5bc2-44f5-bfca-7030ca7d28ef tempest-VolumesTestJSON-429106789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a7290038-5bc2-44f5-bfca-7030ca7d28ef tempest-VolumesTestJSON-429106789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:01 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a7290038-5bc2-44f5-bfca-7030ca7d28ef tempest-VolumesTestJSON-429106789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:40:01 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a7290038-5bc2-44f5-bfca-7030ca7d28ef tempest-VolumesTestJSON-429106789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:40:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a7290038-5bc2-44f5-bfca-7030ca7d28ef tempest-VolumesTestJSON-429106789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a7290038-5bc2-44f5-bfca-7030ca7d28ef tempest-VolumesTestJSON-429106789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:01 devstack sudo[91536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:40:01 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:01 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a7290038-5bc2-44f5-bfca-7030ca7d28ef tempest-VolumesTestJSON-429106789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.244s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:01 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-a7290038-5bc2-44f5-bfca-7030ca7d28ef tempest-VolumesTestJSON-429106789 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:40:01 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-a7290038-5bc2-44f5-bfca-7030ca7d28ef tempest-VolumesTestJSON-429106789 None] Deleted volume successfully. Sep 16 17:40:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a7290038-5bc2-44f5-bfca-7030ca7d28ef tempest-VolumesTestJSON-429106789 None] Lock "cinder-325a8701-720d-4d09-9288-011d53d332ff-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:40:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:40:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:40:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:02 devstack sudo[91539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:40:02 devstack sudo[91539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:02 devstack sudo[91539]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.269s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:40:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager._thread_info {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:40:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread count: 28 {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:40:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread info: [<_MainThread(MainThread, started 123748124422272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Flow 'volume_create_manager' (cd69b7c1-42e3-4a4e-8612-7f3e765b698c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba9dea98-5ecc-4761-b2e2-62c3c976f3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba9dea98-5ecc-4761-b2e2-62c3c976f3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2095662866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7830965a-b834-4ff7-a798-9ea7f59b498d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4b95a0f661453fb1ec8ddfb19fc296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:40:07Z,use_quota=True,user_id='ec1be456423448888e307c1213610b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dc868e2-82f6-4322-84d2-b4dd2a6fc35a),volume_type_id=3dc868e2-82f6-4322-84d2-b4dd2a6fc35a)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b60e2bf-10b0-48f1-9631-9bbb6e5b5292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b60e2bf-10b0-48f1-9631-9bbb6e5b5292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b3ac12a-a268-4e12-bc4a-71500623ed1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b3ac12a-a268-4e12-bc4a-71500623ed1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7830965a-b834-4ff7-a798-9ea7f59b498d', 'volume_name': 'volume-7830965a-b834-4ff7-a798-9ea7f59b498d', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b4f72ac-c58f-4dc7-92e2-617a7d8c0a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b4f72ac-c58f-4dc7-92e2-617a7d8c0a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70fe58c-3cd3-4e92-937c-9c0120b651b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:07 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Volume 7830965a-b834-4ff7-a798-9ea7f59b498d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7830965a-b834-4ff7-a798-9ea7f59b498d', 'volume_size': 1} Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2095662866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7830965a-b834-4ff7-a798-9ea7f59b498d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4b95a0f661453fb1ec8ddfb19fc296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:40:07Z,use_quota=True,user_id='ec1be456423448888e307c1213610b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dc868e2-82f6-4322-84d2-b4dd2a6fc35a),volume_type_id=3dc868e2-82f6-4322-84d2-b4dd2a6fc35a)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Creating volume 7830965a-b834-4ff7-a798-9ea7f59b498d {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:40:07 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7830965a-b834-4ff7-a798-9ea7f59b498d 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:07 devstack sudo[91545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7830965a-b834-4ff7-a798-9ea7f59b498d 1073741824 Sep 16 17:40:07 devstack sudo[91545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:07 devstack sudo[91545]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7830965a-b834-4ff7-a798-9ea7f59b498d 1073741824" returned: 0 in 0.506s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7830965a-b834-4ff7-a798-9ea7f59b498d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:08 devstack sudo[91551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7830965a-b834-4ff7-a798-9ea7f59b498d Sep 16 17:40:08 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:08 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7830965a-b834-4ff7-a798-9ea7f59b498d" returned: 0 in 0.308s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:08 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:40:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:08 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70fe58c-3cd3-4e92-937c-9c0120b651b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7830965a-b834-4ff7-a798-9ea7f59b498d', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:08 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c85da9-107d-427b-918a-94dd1ec355fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:08 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Volume volume-7830965a-b834-4ff7-a798-9ea7f59b498d (7830965a-b834-4ff7-a798-9ea7f59b498d): created successfully Sep 16 17:40:08 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c85da9-107d-427b-918a-94dd1ec355fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:08 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Flow 'volume_create_manager' (cd69b7c1-42e3-4a4e-8612-7f3e765b698c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:40:08 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5f83a848-ed3b-4eab-938c-310772702cad tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Created volume successfully. Sep 16 17:40:09 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:40:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Flow 'volume_create_manager' (71bd47f0-c075-4b15-abfd-f3a9fe9c710d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:40:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ebcb279-c602-46ff-8b5c-cca50a4f3177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ebcb279-c602-46ff-8b5c-cca50a4f3177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1000150404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4849b7c-b698-40fc-9c48-1333b7d8fd9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68de1f557817457c8f2ef60ca15409f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:40:10Z,use_quota=True,user_id='2a2445f5e92247e7b4873f0c11b841a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383418cf-2a63-4822-adbf-655bcd295d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383418cf-2a63-4822-adbf-655bcd295d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba2ff06-b33e-4586-b081-921fe60b9010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba2ff06-b33e-4586-b081-921fe60b9010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4849b7c-b698-40fc-9c48-1333b7d8fd9f', 'volume_name': 'volume-d4849b7c-b698-40fc-9c48-1333b7d8fd9f', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0647e1a-239a-475d-8985-9d4ff7791d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0647e1a-239a-475d-8985-9d4ff7791d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df10500-83fd-4fd6-8f6d-bfb980093385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:09 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Volume d4849b7c-b698-40fc-9c48-1333b7d8fd9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4849b7c-b698-40fc-9c48-1333b7d8fd9f', 'volume_size': 1} Sep 16 17:40:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1000150404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4849b7c-b698-40fc-9c48-1333b7d8fd9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68de1f557817457c8f2ef60ca15409f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:40:10Z,use_quota=True,user_id='2a2445f5e92247e7b4873f0c11b841a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:40:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Creating volume d4849b7c-b698-40fc-9c48-1333b7d8fd9f {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:40:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:40:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:40:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:40:09 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:40:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4849b7c-b698-40fc-9c48-1333b7d8fd9f 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:09 devstack sudo[91556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4849b7c-b698-40fc-9c48-1333b7d8fd9f 1073741824 Sep 16 17:40:09 devstack sudo[91556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ee20a550-5365-480f-b218-65782ee038de tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ee20a550-5365-480f-b218-65782ee038de tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ee20a550-5365-480f-b218-65782ee038de tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:40:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ee20a550-5365-480f-b218-65782ee038de tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:40:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ee20a550-5365-480f-b218-65782ee038de tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ee20a550-5365-480f-b218-65782ee038de tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:10 devstack sudo[91566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:40:10 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:10 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ee20a550-5365-480f-b218-65782ee038de tempest-VolumeRetypeWithoutMigrationTest-767251288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.321s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:10 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-ee20a550-5365-480f-b218-65782ee038de tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:40:10 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-ee20a550-5365-480f-b218-65782ee038de tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Retype volume completed successfully. Sep 16 17:40:10 devstack sudo[91556]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4849b7c-b698-40fc-9c48-1333b7d8fd9f 1073741824" returned: 0 in 0.699s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4849b7c-b698-40fc-9c48-1333b7d8fd9f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:10 devstack sudo[91591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4849b7c-b698-40fc-9c48-1333b7d8fd9f Sep 16 17:40:10 devstack sudo[91591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:10 devstack sudo[91591]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4849b7c-b698-40fc-9c48-1333b7d8fd9f" returned: 0 in 0.398s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:40:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df10500-83fd-4fd6-8f6d-bfb980093385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4849b7c-b698-40fc-9c48-1333b7d8fd9f', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67527fb-9490-415b-9104-7092a2dfbf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:10 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Volume volume-d4849b7c-b698-40fc-9c48-1333b7d8fd9f (d4849b7c-b698-40fc-9c48-1333b7d8fd9f): created successfully Sep 16 17:40:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67527fb-9490-415b-9104-7092a2dfbf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Flow 'volume_create_manager' (71bd47f0-c075-4b15-abfd-f3a9fe9c710d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:40:10 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-12e353cc-cb1f-4f3a-b5ba-b35f98e4d1d7 tempest-VolumeQuotasAdminTestJSON-452391010 None] Created volume successfully. Sep 16 17:40:11 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c6591397-7426-4f2c-bf87-f0be82c05558 tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Acquiring lock "cinder-7830965a-b834-4ff7-a798-9ea7f59b498d-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:40:11 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c6591397-7426-4f2c-bf87-f0be82c05558 tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Lock "cinder-7830965a-b834-4ff7-a798-9ea7f59b498d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:40:11 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c6591397-7426-4f2c-bf87-f0be82c05558 tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Acquiring lock "cinder-quobyte-7830965a-b834-4ff7-a798-9ea7f59b498d" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:40:11 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c6591397-7426-4f2c-bf87-f0be82c05558 tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Lock "cinder-quobyte-7830965a-b834-4ff7-a798-9ea7f59b498d" acquired by "delete_volume" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:40:11 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff78848f-0e38-4207-8c02-fe54dadd010a]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:40:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c6591397-7426-4f2c-bf87-f0be82c05558 tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7830965a-b834-4ff7-a798-9ea7f59b498d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:11 devstack sudo[91616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7830965a-b834-4ff7-a798-9ea7f59b498d Sep 16 17:40:11 devstack sudo[91616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:11 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-620442ec-2d5a-4e36-a873-319f1092aafb tempest-VolumeQuotasAdminTestJSON-452391010 None] Acquiring lock "cinder-d4849b7c-b698-40fc-9c48-1333b7d8fd9f-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:40:11 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-620442ec-2d5a-4e36-a873-319f1092aafb tempest-VolumeQuotasAdminTestJSON-452391010 None] Lock "cinder-d4849b7c-b698-40fc-9c48-1333b7d8fd9f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:40:11 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-620442ec-2d5a-4e36-a873-319f1092aafb tempest-VolumeQuotasAdminTestJSON-452391010 None] Acquiring lock "cinder-quobyte-d4849b7c-b698-40fc-9c48-1333b7d8fd9f" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:40:11 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-620442ec-2d5a-4e36-a873-319f1092aafb tempest-VolumeQuotasAdminTestJSON-452391010 None] Lock "cinder-quobyte-d4849b7c-b698-40fc-9c48-1333b7d8fd9f" acquired by "delete_volume" :: waited 0.025s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:40:12 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc85243d-f3a4-4d54-9470-010415edc53d]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:40:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-620442ec-2d5a-4e36-a873-319f1092aafb tempest-VolumeQuotasAdminTestJSON-452391010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4849b7c-b698-40fc-9c48-1333b7d8fd9f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:12 devstack sudo[91616]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c6591397-7426-4f2c-bf87-f0be82c05558 tempest-VolumeRetypeWithoutMigrationTest-767251288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7830965a-b834-4ff7-a798-9ea7f59b498d" returned: 0 in 0.585s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c6591397-7426-4f2c-bf87-f0be82c05558 tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7830965a-b834-4ff7-a798-9ea7f59b498d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:12 devstack sudo[91627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7830965a-b834-4ff7-a798-9ea7f59b498d Sep 16 17:40:12 devstack sudo[91627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:12 devstack sudo[91626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4849b7c-b698-40fc-9c48-1333b7d8fd9f Sep 16 17:40:12 devstack sudo[91626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:12 devstack sudo[91627]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c6591397-7426-4f2c-bf87-f0be82c05558 tempest-VolumeRetypeWithoutMigrationTest-767251288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7830965a-b834-4ff7-a798-9ea7f59b498d" returned: 0 in 0.288s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:12 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c6591397-7426-4f2c-bf87-f0be82c05558 tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Lock "cinder-quobyte-7830965a-b834-4ff7-a798-9ea7f59b498d" released by "delete_volume" :: held 0.931s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:12 devstack cinder-volume[85899]: WARNING cinder.quota [None req-c6591397-7426-4f2c-bf87-f0be82c05558 tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:40:12 devstack cinder-volume[85899]: WARNING cinder.quota [None req-c6591397-7426-4f2c-bf87-f0be82c05558 tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:40:12 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-c6591397-7426-4f2c-bf87-f0be82c05558 tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Created reservations ['d2cf74d6-50ca-4251-a88a-a069a221d7ad', '1f5231c8-887b-4610-8dfe-0662d5210e70', '9770c8af-8f3d-41d1-9415-ef7f4f32cde4', '47d134dd-1efd-435c-b6db-d4a2b572aaeb'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:40:12 devstack sudo[91626]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-620442ec-2d5a-4e36-a873-319f1092aafb tempest-VolumeQuotasAdminTestJSON-452391010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4849b7c-b698-40fc-9c48-1333b7d8fd9f" returned: 0 in 0.402s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-620442ec-2d5a-4e36-a873-319f1092aafb tempest-VolumeQuotasAdminTestJSON-452391010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4849b7c-b698-40fc-9c48-1333b7d8fd9f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:12 devstack sudo[91634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4849b7c-b698-40fc-9c48-1333b7d8fd9f Sep 16 17:40:12 devstack sudo[91634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c6591397-7426-4f2c-bf87-f0be82c05558 tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c6591397-7426-4f2c-bf87-f0be82c05558 tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:12 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c6591397-7426-4f2c-bf87-f0be82c05558 tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:40:12 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c6591397-7426-4f2c-bf87-f0be82c05558 tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:40:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c6591397-7426-4f2c-bf87-f0be82c05558 tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c6591397-7426-4f2c-bf87-f0be82c05558 tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:12 devstack sudo[91636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:40:12 devstack sudo[91636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:12 devstack sudo[91634]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-620442ec-2d5a-4e36-a873-319f1092aafb tempest-VolumeQuotasAdminTestJSON-452391010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4849b7c-b698-40fc-9c48-1333b7d8fd9f" returned: 0 in 0.383s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:12 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-620442ec-2d5a-4e36-a873-319f1092aafb tempest-VolumeQuotasAdminTestJSON-452391010 None] Lock "cinder-quobyte-d4849b7c-b698-40fc-9c48-1333b7d8fd9f" released by "delete_volume" :: held 0.847s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:12 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-620442ec-2d5a-4e36-a873-319f1092aafb tempest-VolumeQuotasAdminTestJSON-452391010 None] Created reservations ['475b7dfe-ca6d-4470-bc4a-43f06e0d55ac', 'ffc7e18f-c371-45ca-a58d-55fccc6cdc8a', '6f5e68a1-5999-462f-b68e-10df32177e97', '1bd7b39f-1bda-458d-9624-01d39e626b69'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:40:12 devstack sudo[91636]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c6591397-7426-4f2c-bf87-f0be82c05558 tempest-VolumeRetypeWithoutMigrationTest-767251288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.412s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:12 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-c6591397-7426-4f2c-bf87-f0be82c05558 tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:40:12 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-c6591397-7426-4f2c-bf87-f0be82c05558 tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Deleted volume successfully. Sep 16 17:40:12 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c6591397-7426-4f2c-bf87-f0be82c05558 tempest-VolumeRetypeWithoutMigrationTest-767251288 None] Lock "cinder-7830965a-b834-4ff7-a798-9ea7f59b498d-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-620442ec-2d5a-4e36-a873-319f1092aafb tempest-VolumeQuotasAdminTestJSON-452391010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-620442ec-2d5a-4e36-a873-319f1092aafb tempest-VolumeQuotasAdminTestJSON-452391010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:13 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-620442ec-2d5a-4e36-a873-319f1092aafb tempest-VolumeQuotasAdminTestJSON-452391010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:40:13 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-620442ec-2d5a-4e36-a873-319f1092aafb tempest-VolumeQuotasAdminTestJSON-452391010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:40:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-620442ec-2d5a-4e36-a873-319f1092aafb tempest-VolumeQuotasAdminTestJSON-452391010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-620442ec-2d5a-4e36-a873-319f1092aafb tempest-VolumeQuotasAdminTestJSON-452391010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:13 devstack sudo[91640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:40:13 devstack sudo[91640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:13 devstack sudo[91640]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-620442ec-2d5a-4e36-a873-319f1092aafb tempest-VolumeQuotasAdminTestJSON-452391010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.257s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:13 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-620442ec-2d5a-4e36-a873-319f1092aafb tempest-VolumeQuotasAdminTestJSON-452391010 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:40:13 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-620442ec-2d5a-4e36-a873-319f1092aafb tempest-VolumeQuotasAdminTestJSON-452391010 None] Deleted volume successfully. Sep 16 17:40:13 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-620442ec-2d5a-4e36-a873-319f1092aafb tempest-VolumeQuotasAdminTestJSON-452391010 None] Lock "cinder-d4849b7c-b698-40fc-9c48-1333b7d8fd9f-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Flow 'volume_create_manager' (4c488ebe-33d7-4a43-a38e-2c48a7ea8aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b2c3b3-b23b-409b-9ebe-1e43bb977574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b2c3b3-b23b-409b-9ebe-1e43bb977574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-537042078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601957d8-1b09-48af-abe1-14e9eb1dd05f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68de1f557817457c8f2ef60ca15409f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:40:15Z,use_quota=True,user_id='2a2445f5e92247e7b4873f0c11b841a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d25105-6413-4903-b694-adc9fd22955b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d25105-6413-4903-b694-adc9fd22955b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0a7c9c5-9fdd-42d7-97de-db327dd273ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0a7c9c5-9fdd-42d7-97de-db327dd273ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '601957d8-1b09-48af-abe1-14e9eb1dd05f', 'volume_name': 'volume-601957d8-1b09-48af-abe1-14e9eb1dd05f', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884e6a35-fe93-4f2f-a2f8-9eda76b3ad4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884e6a35-fe93-4f2f-a2f8-9eda76b3ad4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f36c497-1d88-41a2-a216-9cf713c63eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:15 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Volume 601957d8-1b09-48af-abe1-14e9eb1dd05f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-601957d8-1b09-48af-abe1-14e9eb1dd05f', 'volume_size': 1} Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-537042078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601957d8-1b09-48af-abe1-14e9eb1dd05f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68de1f557817457c8f2ef60ca15409f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:40:15Z,use_quota=True,user_id='2a2445f5e92247e7b4873f0c11b841a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Creating volume 601957d8-1b09-48af-abe1-14e9eb1dd05f {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:40:15 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-601957d8-1b09-48af-abe1-14e9eb1dd05f 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:15 devstack sudo[91670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-601957d8-1b09-48af-abe1-14e9eb1dd05f 1073741824 Sep 16 17:40:15 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:15 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-601957d8-1b09-48af-abe1-14e9eb1dd05f 1073741824" returned: 0 in 0.589s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-601957d8-1b09-48af-abe1-14e9eb1dd05f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:15 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-601957d8-1b09-48af-abe1-14e9eb1dd05f Sep 16 17:40:15 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:16 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-601957d8-1b09-48af-abe1-14e9eb1dd05f" returned: 0 in 0.335s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:16 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:40:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f36c497-1d88-41a2-a216-9cf713c63eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-601957d8-1b09-48af-abe1-14e9eb1dd05f', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc90a450-cc6f-4534-abda-6ebb7ef4b56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:16 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Volume volume-601957d8-1b09-48af-abe1-14e9eb1dd05f (601957d8-1b09-48af-abe1-14e9eb1dd05f): created successfully Sep 16 17:40:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc90a450-cc6f-4534-abda-6ebb7ef4b56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Flow 'volume_create_manager' (4c488ebe-33d7-4a43-a38e-2c48a7ea8aa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:40:16 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-e46af065-b845-4a1e-9e7e-b77e5d14baad tempest-VolumeQuotasAdminTestJSON-452391010 None] Created volume successfully. Sep 16 17:40:16 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-eb915768-3134-4c31-a197-797e7cfef4e6 req-d5fefce4-cd06-4584-86e8-6d9d59f242d5 tempest-ServerActionsTestOtherA-1725898912 None] Terminate volume connection completed successfully. Sep 16 17:40:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-eb915768-3134-4c31-a197-797e7cfef4e6 req-d5fefce4-cd06-4584-86e8-6d9d59f242d5 tempest-ServerActionsTestOtherA-1725898912 None] Deleting attachment 0a926897-fcb5-484b-9e83-ac3ad09be18e. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:40:16 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-eb915768-3134-4c31-a197-797e7cfef4e6 req-53869d5a-bdd5-4d11-ac78-9f5d6add9482 tempest-ServerActionsTestOtherA-1725898912 None] Acquiring lock "cinder-55da318f-2c82-47ff-bc72-9f94452da684-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:40:16 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-eb915768-3134-4c31-a197-797e7cfef4e6 req-53869d5a-bdd5-4d11-ac78-9f5d6add9482 tempest-ServerActionsTestOtherA-1725898912 None] Lock "cinder-55da318f-2c82-47ff-bc72-9f94452da684-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:40:16 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-eb915768-3134-4c31-a197-797e7cfef4e6 req-53869d5a-bdd5-4d11-ac78-9f5d6add9482 tempest-ServerActionsTestOtherA-1725898912 None] Acquiring lock "cinder-quobyte-55da318f-2c82-47ff-bc72-9f94452da684" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:40:16 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-eb915768-3134-4c31-a197-797e7cfef4e6 req-53869d5a-bdd5-4d11-ac78-9f5d6add9482 tempest-ServerActionsTestOtherA-1725898912 None] Lock "cinder-quobyte-55da318f-2c82-47ff-bc72-9f94452da684" acquired by "delete_volume" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:40:16 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7437db3a-afa2-4bb7-9db4-7a66c520dd81]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:40:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-eb915768-3134-4c31-a197-797e7cfef4e6 req-53869d5a-bdd5-4d11-ac78-9f5d6add9482 tempest-ServerActionsTestOtherA-1725898912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-55da318f-2c82-47ff-bc72-9f94452da684 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:16 devstack sudo[91683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-55da318f-2c82-47ff-bc72-9f94452da684 Sep 16 17:40:16 devstack sudo[91683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:17 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-e602b110-35f2-4eb7-8cf2-fc7b91c0832d req-2b60fc19-8523-4146-b42d-4fe0a6b7a2cf tempest-AttachVolumeNegativeTest-195502489 None] Terminate volume connection completed successfully. Sep 16 17:40:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-e602b110-35f2-4eb7-8cf2-fc7b91c0832d req-2b60fc19-8523-4146-b42d-4fe0a6b7a2cf tempest-AttachVolumeNegativeTest-195502489 None] Deleting attachment 0c79e9b3-4e5f-45a8-9a34-1e91a3477b8e. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:40:17 devstack sudo[91683]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-eb915768-3134-4c31-a197-797e7cfef4e6 req-53869d5a-bdd5-4d11-ac78-9f5d6add9482 tempest-ServerActionsTestOtherA-1725898912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-55da318f-2c82-47ff-bc72-9f94452da684" returned: 0 in 0.681s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-eb915768-3134-4c31-a197-797e7cfef4e6 req-53869d5a-bdd5-4d11-ac78-9f5d6add9482 tempest-ServerActionsTestOtherA-1725898912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-55da318f-2c82-47ff-bc72-9f94452da684 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:17 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-55da318f-2c82-47ff-bc72-9f94452da684 Sep 16 17:40:17 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:17 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-eb915768-3134-4c31-a197-797e7cfef4e6 req-53869d5a-bdd5-4d11-ac78-9f5d6add9482 tempest-ServerActionsTestOtherA-1725898912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-55da318f-2c82-47ff-bc72-9f94452da684" returned: 0 in 0.335s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-eb915768-3134-4c31-a197-797e7cfef4e6 req-53869d5a-bdd5-4d11-ac78-9f5d6add9482 tempest-ServerActionsTestOtherA-1725898912 None] Lock "cinder-quobyte-55da318f-2c82-47ff-bc72-9f94452da684" released by "delete_volume" :: held 1.074s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:17 devstack cinder-volume[85899]: DEBUG cinder.quota [req-eb915768-3134-4c31-a197-797e7cfef4e6 req-53869d5a-bdd5-4d11-ac78-9f5d6add9482 tempest-ServerActionsTestOtherA-1725898912 None] Created reservations ['9a112229-f723-4cfc-a704-be13288275ce', '0593fbcb-bd27-4c45-a483-70bbe9c73c50', 'c49f0671-fcdf-46d0-94a4-b72c585b4f48', 'fabee2da-5d94-4955-91d8-44657bbadab1'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:40:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-eb915768-3134-4c31-a197-797e7cfef4e6 req-53869d5a-bdd5-4d11-ac78-9f5d6add9482 tempest-ServerActionsTestOtherA-1725898912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-eb915768-3134-4c31-a197-797e7cfef4e6 req-53869d5a-bdd5-4d11-ac78-9f5d6add9482 tempest-ServerActionsTestOtherA-1725898912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [req-eb915768-3134-4c31-a197-797e7cfef4e6 req-53869d5a-bdd5-4d11-ac78-9f5d6add9482 tempest-ServerActionsTestOtherA-1725898912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:40:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [req-eb915768-3134-4c31-a197-797e7cfef4e6 req-53869d5a-bdd5-4d11-ac78-9f5d6add9482 tempest-ServerActionsTestOtherA-1725898912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:40:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-eb915768-3134-4c31-a197-797e7cfef4e6 req-53869d5a-bdd5-4d11-ac78-9f5d6add9482 tempest-ServerActionsTestOtherA-1725898912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-eb915768-3134-4c31-a197-797e7cfef4e6 req-53869d5a-bdd5-4d11-ac78-9f5d6add9482 tempest-ServerActionsTestOtherA-1725898912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:18 devstack sudo[91694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:40:18 devstack sudo[91694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:18 devstack sudo[91694]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-eb915768-3134-4c31-a197-797e7cfef4e6 req-53869d5a-bdd5-4d11-ac78-9f5d6add9482 tempest-ServerActionsTestOtherA-1725898912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.355s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:18 devstack cinder-volume[85899]: DEBUG cinder.manager [req-eb915768-3134-4c31-a197-797e7cfef4e6 req-53869d5a-bdd5-4d11-ac78-9f5d6add9482 tempest-ServerActionsTestOtherA-1725898912 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:40:18 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-eb915768-3134-4c31-a197-797e7cfef4e6 req-53869d5a-bdd5-4d11-ac78-9f5d6add9482 tempest-ServerActionsTestOtherA-1725898912 None] Deleted volume successfully. Sep 16 17:40:18 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-eb915768-3134-4c31-a197-797e7cfef4e6 req-53869d5a-bdd5-4d11-ac78-9f5d6add9482 tempest-ServerActionsTestOtherA-1725898912 None] Lock "cinder-55da318f-2c82-47ff-bc72-9f94452da684-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:18 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-ce654193-7831-4fe6-991b-d3d980c9b5dc tempest-VolumeQuotasAdminTestJSON-975382753 None] Transfer volume completed successfully. Sep 16 17:40:18 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fd3ecb9d-2190-477e-9e50-4ff17926b702 tempest-ServerActionsTestOtherA-1725898912 None] Acquiring lock "cinder-b219be60-ed15-4884-9953-fe2a458dec4d-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:40:18 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fd3ecb9d-2190-477e-9e50-4ff17926b702 tempest-ServerActionsTestOtherA-1725898912 None] Lock "cinder-b219be60-ed15-4884-9953-fe2a458dec4d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:40:19 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fd3ecb9d-2190-477e-9e50-4ff17926b702 tempest-ServerActionsTestOtherA-1725898912 None] Acquiring lock "cinder-quobyte-b219be60-ed15-4884-9953-fe2a458dec4d" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:40:19 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fd3ecb9d-2190-477e-9e50-4ff17926b702 tempest-ServerActionsTestOtherA-1725898912 None] Lock "cinder-quobyte-b219be60-ed15-4884-9953-fe2a458dec4d" acquired by "delete_volume" :: waited 0.027s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:40:19 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b43a3c-f75d-4942-abdb-15d760ee5205]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:40:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fd3ecb9d-2190-477e-9e50-4ff17926b702 tempest-ServerActionsTestOtherA-1725898912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b219be60-ed15-4884-9953-fe2a458dec4d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:19 devstack sudo[91716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b219be60-ed15-4884-9953-fe2a458dec4d Sep 16 17:40:19 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:19 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e3483942-b5e6-4f43-bfba-4486663ba023 tempest-VolumeQuotasAdminTestJSON-63531055 None] Acquiring lock "cinder-601957d8-1b09-48af-abe1-14e9eb1dd05f-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:40:19 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e3483942-b5e6-4f43-bfba-4486663ba023 tempest-VolumeQuotasAdminTestJSON-63531055 None] Lock "cinder-601957d8-1b09-48af-abe1-14e9eb1dd05f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:40:19 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e3483942-b5e6-4f43-bfba-4486663ba023 tempest-VolumeQuotasAdminTestJSON-63531055 None] Acquiring lock "cinder-quobyte-601957d8-1b09-48af-abe1-14e9eb1dd05f" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:40:19 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e3483942-b5e6-4f43-bfba-4486663ba023 tempest-VolumeQuotasAdminTestJSON-63531055 None] Lock "cinder-quobyte-601957d8-1b09-48af-abe1-14e9eb1dd05f" acquired by "delete_volume" :: waited 0.035s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:40:19 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47a6a03-a01d-487f-9ca0-2e9963f35bb0]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:40:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e3483942-b5e6-4f43-bfba-4486663ba023 tempest-VolumeQuotasAdminTestJSON-63531055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-601957d8-1b09-48af-abe1-14e9eb1dd05f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:19 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fd3ecb9d-2190-477e-9e50-4ff17926b702 tempest-ServerActionsTestOtherA-1725898912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b219be60-ed15-4884-9953-fe2a458dec4d" returned: 0 in 0.659s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fd3ecb9d-2190-477e-9e50-4ff17926b702 tempest-ServerActionsTestOtherA-1725898912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b219be60-ed15-4884-9953-fe2a458dec4d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:19 devstack sudo[91719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-601957d8-1b09-48af-abe1-14e9eb1dd05f Sep 16 17:40:19 devstack sudo[91719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:19 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b219be60-ed15-4884-9953-fe2a458dec4d Sep 16 17:40:19 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:20 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fd3ecb9d-2190-477e-9e50-4ff17926b702 tempest-ServerActionsTestOtherA-1725898912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b219be60-ed15-4884-9953-fe2a458dec4d" returned: 0 in 0.345s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fd3ecb9d-2190-477e-9e50-4ff17926b702 tempest-ServerActionsTestOtherA-1725898912 None] Lock "cinder-quobyte-b219be60-ed15-4884-9953-fe2a458dec4d" released by "delete_volume" :: held 1.081s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:20 devstack sudo[91719]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e3483942-b5e6-4f43-bfba-4486663ba023 tempest-VolumeQuotasAdminTestJSON-63531055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-601957d8-1b09-48af-abe1-14e9eb1dd05f" returned: 0 in 0.591s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e3483942-b5e6-4f43-bfba-4486663ba023 tempest-VolumeQuotasAdminTestJSON-63531055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-601957d8-1b09-48af-abe1-14e9eb1dd05f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:20 devstack sudo[91734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-601957d8-1b09-48af-abe1-14e9eb1dd05f Sep 16 17:40:20 devstack sudo[91734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:20 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-fd3ecb9d-2190-477e-9e50-4ff17926b702 tempest-ServerActionsTestOtherA-1725898912 None] Created reservations ['75b7c37e-84c1-4f70-96a9-bc90a561a359', '83b6ddcd-d399-4849-8959-d55d61b746dc', '46de4ca5-c7d8-4604-a6eb-85d36064a3b1', '16115e20-fca2-4e1b-8ac5-0453a03ac131'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:40:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fd3ecb9d-2190-477e-9e50-4ff17926b702 tempest-ServerActionsTestOtherA-1725898912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fd3ecb9d-2190-477e-9e50-4ff17926b702 tempest-ServerActionsTestOtherA-1725898912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fd3ecb9d-2190-477e-9e50-4ff17926b702 tempest-ServerActionsTestOtherA-1725898912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:40:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fd3ecb9d-2190-477e-9e50-4ff17926b702 tempest-ServerActionsTestOtherA-1725898912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:40:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fd3ecb9d-2190-477e-9e50-4ff17926b702 tempest-ServerActionsTestOtherA-1725898912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fd3ecb9d-2190-477e-9e50-4ff17926b702 tempest-ServerActionsTestOtherA-1725898912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:20 devstack sudo[91736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:40:20 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:20 devstack sudo[91734]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e3483942-b5e6-4f43-bfba-4486663ba023 tempest-VolumeQuotasAdminTestJSON-63531055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-601957d8-1b09-48af-abe1-14e9eb1dd05f" returned: 0 in 0.364s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e3483942-b5e6-4f43-bfba-4486663ba023 tempest-VolumeQuotasAdminTestJSON-63531055 None] Lock "cinder-quobyte-601957d8-1b09-48af-abe1-14e9eb1dd05f" released by "delete_volume" :: held 1.061s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:20 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-e3483942-b5e6-4f43-bfba-4486663ba023 tempest-VolumeQuotasAdminTestJSON-63531055 None] Created reservations ['a1001346-6483-4bf2-bd24-3c895f852a04', '9493f52c-6bc5-47a6-a028-486c2814da1f', 'c6c84075-a0ee-4fec-b7f2-d8bbdb529f6d', '6a961ec1-6c15-4159-a48a-69ec82041c73'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:40:20 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fd3ecb9d-2190-477e-9e50-4ff17926b702 tempest-ServerActionsTestOtherA-1725898912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.323s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:20 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-fd3ecb9d-2190-477e-9e50-4ff17926b702 tempest-ServerActionsTestOtherA-1725898912 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:40:20 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-fd3ecb9d-2190-477e-9e50-4ff17926b702 tempest-ServerActionsTestOtherA-1725898912 None] Deleted volume successfully. Sep 16 17:40:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fd3ecb9d-2190-477e-9e50-4ff17926b702 tempest-ServerActionsTestOtherA-1725898912 None] Lock "cinder-b219be60-ed15-4884-9953-fe2a458dec4d-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e3483942-b5e6-4f43-bfba-4486663ba023 tempest-VolumeQuotasAdminTestJSON-63531055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e3483942-b5e6-4f43-bfba-4486663ba023 tempest-VolumeQuotasAdminTestJSON-63531055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e3483942-b5e6-4f43-bfba-4486663ba023 tempest-VolumeQuotasAdminTestJSON-63531055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:40:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e3483942-b5e6-4f43-bfba-4486663ba023 tempest-VolumeQuotasAdminTestJSON-63531055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:40:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e3483942-b5e6-4f43-bfba-4486663ba023 tempest-VolumeQuotasAdminTestJSON-63531055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e3483942-b5e6-4f43-bfba-4486663ba023 tempest-VolumeQuotasAdminTestJSON-63531055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:20 devstack sudo[91741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:40:20 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:21 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e3483942-b5e6-4f43-bfba-4486663ba023 tempest-VolumeQuotasAdminTestJSON-63531055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.287s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:21 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-e3483942-b5e6-4f43-bfba-4486663ba023 tempest-VolumeQuotasAdminTestJSON-63531055 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:40:21 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-e3483942-b5e6-4f43-bfba-4486663ba023 tempest-VolumeQuotasAdminTestJSON-63531055 None] Deleted volume successfully. Sep 16 17:40:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e3483942-b5e6-4f43-bfba-4486663ba023 tempest-VolumeQuotasAdminTestJSON-63531055 None] Lock "cinder-601957d8-1b09-48af-abe1-14e9eb1dd05f-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Flow 'volume_create_manager' (1752cf90-33e5-4b37-9350-3084bfddbb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52bf7f6-a7d2-48f9-a771-de86d6cbc7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52bf7f6-a7d2-48f9-a771-de86d6cbc7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1044934836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449614f6-008b-40d7-bc56-520be3cdba7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169a8467e43f45ad90ec0233f2867b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:40:23Z,use_quota=True,user_id='bc19cd9e08494bdc929d60972ddbbcdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea93637a-71d1-44d4-b3e0-30c212b2ceea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea93637a-71d1-44d4-b3e0-30c212b2ceea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0d2af7-c807-451e-a28c-89f3e98e657a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0d2af7-c807-451e-a28c-89f3e98e657a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '449614f6-008b-40d7-bc56-520be3cdba7c', 'volume_name': 'volume-449614f6-008b-40d7-bc56-520be3cdba7c', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c811adfe-b569-4ae9-a83f-d8cc9d96376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c811adfe-b569-4ae9-a83f-d8cc9d96376e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3fa7e4c-1e61-472a-99b4-572c3630aef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:23 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Volume 449614f6-008b-40d7-bc56-520be3cdba7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-449614f6-008b-40d7-bc56-520be3cdba7c', 'volume_size': 1} Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1044934836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449614f6-008b-40d7-bc56-520be3cdba7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169a8467e43f45ad90ec0233f2867b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:40:23Z,use_quota=True,user_id='bc19cd9e08494bdc929d60972ddbbcdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Creating volume 449614f6-008b-40d7-bc56-520be3cdba7c {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:40:23 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-449614f6-008b-40d7-bc56-520be3cdba7c 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:23 devstack sudo[91765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-449614f6-008b-40d7-bc56-520be3cdba7c 1073741824 Sep 16 17:40:23 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:23 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-449614f6-008b-40d7-bc56-520be3cdba7c 1073741824" returned: 0 in 0.629s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-449614f6-008b-40d7-bc56-520be3cdba7c {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:23 devstack sudo[91773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-449614f6-008b-40d7-bc56-520be3cdba7c Sep 16 17:40:23 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:24 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-449614f6-008b-40d7-bc56-520be3cdba7c" returned: 0 in 0.311s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:40:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3fa7e4c-1e61-472a-99b4-572c3630aef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-449614f6-008b-40d7-bc56-520be3cdba7c', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75729a72-87e9-4d7d-ba56-1f6a048c6d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:24 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Volume volume-449614f6-008b-40d7-bc56-520be3cdba7c (449614f6-008b-40d7-bc56-520be3cdba7c): created successfully Sep 16 17:40:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75729a72-87e9-4d7d-ba56-1f6a048c6d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Flow 'volume_create_manager' (1752cf90-33e5-4b37-9350-3084bfddbb6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:40:24 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-8cfe072c-409f-40ca-ae3b-229b9f2f2de6 tempest-VolumesServicesTestJSON-764436922 None] Created volume successfully. Sep 16 17:40:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9c77b9df-be41-4c01-ad96-04e2b07e4cc2 tempest-VolumesServicesTestJSON-764436922 None] Acquiring lock "cinder-449614f6-008b-40d7-bc56-520be3cdba7c-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:40:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9c77b9df-be41-4c01-ad96-04e2b07e4cc2 tempest-VolumesServicesTestJSON-764436922 None] Lock "cinder-449614f6-008b-40d7-bc56-520be3cdba7c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:40:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9c77b9df-be41-4c01-ad96-04e2b07e4cc2 tempest-VolumesServicesTestJSON-764436922 None] Acquiring lock "cinder-quobyte-449614f6-008b-40d7-bc56-520be3cdba7c" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:40:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9c77b9df-be41-4c01-ad96-04e2b07e4cc2 tempest-VolumesServicesTestJSON-764436922 None] Lock "cinder-quobyte-449614f6-008b-40d7-bc56-520be3cdba7c" acquired by "delete_volume" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:40:25 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce780c6-da72-403a-987f-1958be4867d0]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:40:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9c77b9df-be41-4c01-ad96-04e2b07e4cc2 tempest-VolumesServicesTestJSON-764436922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-449614f6-008b-40d7-bc56-520be3cdba7c {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:25 devstack sudo[91776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-449614f6-008b-40d7-bc56-520be3cdba7c Sep 16 17:40:25 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:25 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9c77b9df-be41-4c01-ad96-04e2b07e4cc2 tempest-VolumesServicesTestJSON-764436922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-449614f6-008b-40d7-bc56-520be3cdba7c" returned: 0 in 0.477s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9c77b9df-be41-4c01-ad96-04e2b07e4cc2 tempest-VolumesServicesTestJSON-764436922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-449614f6-008b-40d7-bc56-520be3cdba7c {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:25 devstack sudo[91781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-449614f6-008b-40d7-bc56-520be3cdba7c Sep 16 17:40:25 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:26 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9c77b9df-be41-4c01-ad96-04e2b07e4cc2 tempest-VolumesServicesTestJSON-764436922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-449614f6-008b-40d7-bc56-520be3cdba7c" returned: 0 in 0.275s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:26 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9c77b9df-be41-4c01-ad96-04e2b07e4cc2 tempest-VolumesServicesTestJSON-764436922 None] Lock "cinder-quobyte-449614f6-008b-40d7-bc56-520be3cdba7c" released by "delete_volume" :: held 0.826s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:26 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=122,cinder:INSERT=26,cinder:UPDATE=130,cinder:DELETE=13 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:40:26 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-9c77b9df-be41-4c01-ad96-04e2b07e4cc2 tempest-VolumesServicesTestJSON-764436922 None] Created reservations ['c0caf8aa-8078-40f1-a09b-3800ca9a47bf', '517e926f-fe7a-42bc-8ae7-8cc4e470e478', 'de483765-daa4-440d-bc55-03238380936e', '8378dc62-18b9-4139-8482-c1645325fb1c'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:40:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9c77b9df-be41-4c01-ad96-04e2b07e4cc2 tempest-VolumesServicesTestJSON-764436922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9c77b9df-be41-4c01-ad96-04e2b07e4cc2 tempest-VolumesServicesTestJSON-764436922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9c77b9df-be41-4c01-ad96-04e2b07e4cc2 tempest-VolumesServicesTestJSON-764436922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:40:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9c77b9df-be41-4c01-ad96-04e2b07e4cc2 tempest-VolumesServicesTestJSON-764436922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:40:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9c77b9df-be41-4c01-ad96-04e2b07e4cc2 tempest-VolumesServicesTestJSON-764436922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9c77b9df-be41-4c01-ad96-04e2b07e4cc2 tempest-VolumesServicesTestJSON-764436922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:26 devstack sudo[91784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:40:26 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:26 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9c77b9df-be41-4c01-ad96-04e2b07e4cc2 tempest-VolumesServicesTestJSON-764436922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.497s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:26 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-9c77b9df-be41-4c01-ad96-04e2b07e4cc2 tempest-VolumesServicesTestJSON-764436922 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:40:26 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-9c77b9df-be41-4c01-ad96-04e2b07e4cc2 tempest-VolumesServicesTestJSON-764436922 None] Deleted volume successfully. Sep 16 17:40:26 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9c77b9df-be41-4c01-ad96-04e2b07e4cc2 tempest-VolumesServicesTestJSON-764436922 None] Lock "cinder-449614f6-008b-40d7-bc56-520be3cdba7c-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:UPDATE=148,cinder:SELECT=113,cinder:INSERT=35,cinder:DELETE=7 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Flow 'volume_create_manager' (8fc3060d-53ca-453e-8ffa-2cad1f38adc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e4e26d-ae9e-4ea0-8f3c-564d26e99201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e4e26d-ae9e-4ea0-8f3c-564d26e99201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1605153038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d4e4fe-3ff6-4824-b14b-44c7388a30c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f034b8a67a8f49069f147ad6a5c44350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:40:32Z,use_quota=True,user_id='a2f8ca87da24476e8d5177fca66d7453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b77b2a-1aab-402b-a26b-449e4f63934c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b77b2a-1aab-402b-a26b-449e4f63934c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1dd8e3-a51c-414d-90f1-8a0bbc6df4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1dd8e3-a51c-414d-90f1-8a0bbc6df4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1d4e4fe-3ff6-4824-b14b-44c7388a30c0', 'volume_name': 'volume-e1d4e4fe-3ff6-4824-b14b-44c7388a30c0', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a29811-4efd-45cd-8d0f-6642553fcf63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a29811-4efd-45cd-8d0f-6642553fcf63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60813ab8-cf6d-434e-98a0-fb55dff52c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:32 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Volume e1d4e4fe-3ff6-4824-b14b-44c7388a30c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1d4e4fe-3ff6-4824-b14b-44c7388a30c0', 'volume_size': 1} Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1605153038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d4e4fe-3ff6-4824-b14b-44c7388a30c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f034b8a67a8f49069f147ad6a5c44350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:40:32Z,use_quota=True,user_id='a2f8ca87da24476e8d5177fca66d7453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Creating volume e1d4e4fe-3ff6-4824-b14b-44c7388a30c0 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:40:32 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1d4e4fe-3ff6-4824-b14b-44c7388a30c0 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:32 devstack sudo[91812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1d4e4fe-3ff6-4824-b14b-44c7388a30c0 1073741824 Sep 16 17:40:32 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:32 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1d4e4fe-3ff6-4824-b14b-44c7388a30c0 1073741824" returned: 0 in 0.727s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1d4e4fe-3ff6-4824-b14b-44c7388a30c0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:33 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1d4e4fe-3ff6-4824-b14b-44c7388a30c0 Sep 16 17:40:33 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:33 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1d4e4fe-3ff6-4824-b14b-44c7388a30c0" returned: 0 in 0.820s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:40:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60813ab8-cf6d-434e-98a0-fb55dff52c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1d4e4fe-3ff6-4824-b14b-44c7388a30c0', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b317937c-f348-4902-b340-9a2b4b918550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:33 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Volume volume-e1d4e4fe-3ff6-4824-b14b-44c7388a30c0 (e1d4e4fe-3ff6-4824-b14b-44c7388a30c0): created successfully Sep 16 17:40:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b317937c-f348-4902-b340-9a2b4b918550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Flow 'volume_create_manager' (8fc3060d-53ca-453e-8ffa-2cad1f38adc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:40:34 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-b9b4d759-34cc-48da-b17f-694a4a447716 tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Created volume successfully. Sep 16 17:40:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-20f74430-496d-4ce7-a395-3dad74eb719d tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Acquiring lock "cinder-e1d4e4fe-3ff6-4824-b14b-44c7388a30c0-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:40:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-20f74430-496d-4ce7-a395-3dad74eb719d tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Lock "cinder-e1d4e4fe-3ff6-4824-b14b-44c7388a30c0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:40:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-20f74430-496d-4ce7-a395-3dad74eb719d tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Acquiring lock "cinder-quobyte-e1d4e4fe-3ff6-4824-b14b-44c7388a30c0" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:40:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-20f74430-496d-4ce7-a395-3dad74eb719d tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Lock "cinder-quobyte-e1d4e4fe-3ff6-4824-b14b-44c7388a30c0" acquired by "delete_volume" :: waited 0.025s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:40:36 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[128d2762-24e9-4b5c-8864-de5642595d58]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:40:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20f74430-496d-4ce7-a395-3dad74eb719d tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1d4e4fe-3ff6-4824-b14b-44c7388a30c0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:36 devstack sudo[91929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1d4e4fe-3ff6-4824-b14b-44c7388a30c0 Sep 16 17:40:36 devstack sudo[91929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:36 devstack sudo[91929]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20f74430-496d-4ce7-a395-3dad74eb719d tempest-VolumeQuotasNegativeTestJSON-1463446644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1d4e4fe-3ff6-4824-b14b-44c7388a30c0" returned: 0 in 0.692s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20f74430-496d-4ce7-a395-3dad74eb719d tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1d4e4fe-3ff6-4824-b14b-44c7388a30c0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:37 devstack sudo[91934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1d4e4fe-3ff6-4824-b14b-44c7388a30c0 Sep 16 17:40:37 devstack sudo[91934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:37 devstack sudo[91934]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20f74430-496d-4ce7-a395-3dad74eb719d tempest-VolumeQuotasNegativeTestJSON-1463446644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1d4e4fe-3ff6-4824-b14b-44c7388a30c0" returned: 0 in 0.473s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-20f74430-496d-4ce7-a395-3dad74eb719d tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Lock "cinder-quobyte-e1d4e4fe-3ff6-4824-b14b-44c7388a30c0" released by "delete_volume" :: held 1.238s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:37 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-20f74430-496d-4ce7-a395-3dad74eb719d tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Created reservations ['cf5f6cd3-6c32-424d-a280-84e53086e09c', 'd00c984f-9f95-44f5-9e04-acaa0f6b1d67', 'c1a968cf-2236-4215-9ee0-b9645690796e', 'e2f0c9c0-e2e1-4f52-89b0-45d8b658539c'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:40:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-20f74430-496d-4ce7-a395-3dad74eb719d tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-20f74430-496d-4ce7-a395-3dad74eb719d tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:37 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-20f74430-496d-4ce7-a395-3dad74eb719d tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:40:37 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-20f74430-496d-4ce7-a395-3dad74eb719d tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:40:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-20f74430-496d-4ce7-a395-3dad74eb719d tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20f74430-496d-4ce7-a395-3dad74eb719d tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:37 devstack sudo[91937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:40:37 devstack sudo[91937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:38 devstack sudo[91937]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20f74430-496d-4ce7-a395-3dad74eb719d tempest-VolumeQuotasNegativeTestJSON-1463446644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.394s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:38 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-20f74430-496d-4ce7-a395-3dad74eb719d tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:40:38 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-20f74430-496d-4ce7-a395-3dad74eb719d tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Deleted volume successfully. Sep 16 17:40:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-20f74430-496d-4ce7-a395-3dad74eb719d tempest-VolumeQuotasNegativeTestJSON-1463446644 None] Lock "cinder-e1d4e4fe-3ff6-4824-b14b-44c7388a30c0-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:39 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:40:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Flow 'volume_create_manager' (13cebd88-49d4-45f4-91e7-24ee8e0f69da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:40:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c43c40-0d95-49c8-97e4-d72123c6dd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c43c40-0d95-49c8-97e4-d72123c6dd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1216057603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=116f1f46-5757-4fe1-9572-3fb93071906f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af18165e45464ad6a295336a1f4a3e3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:40:39Z,use_quota=True,user_id='edf3c6e32c1141219e13fe4d81bb6bb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7564df9-73c5-4c65-bf87-6f5627c299eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7564df9-73c5-4c65-bf87-6f5627c299eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf3c911-5bb3-4327-bce5-a695a787a847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf3c911-5bb3-4327-bce5-a695a787a847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '116f1f46-5757-4fe1-9572-3fb93071906f', 'volume_name': 'volume-116f1f46-5757-4fe1-9572-3fb93071906f', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01430904-28c1-4037-a19a-ac69519dba02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01430904-28c1-4037-a19a-ac69519dba02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e18613f-3658-4067-ac3f-f6e6e8696bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:39 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Volume 116f1f46-5757-4fe1-9572-3fb93071906f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-116f1f46-5757-4fe1-9572-3fb93071906f', 'volume_size': 1} Sep 16 17:40:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1216057603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=116f1f46-5757-4fe1-9572-3fb93071906f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af18165e45464ad6a295336a1f4a3e3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:40:39Z,use_quota=True,user_id='edf3c6e32c1141219e13fe4d81bb6bb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:40:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Creating volume 116f1f46-5757-4fe1-9572-3fb93071906f {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:40:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:40:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:40:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:40:39 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:40:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:39 devstack sudo[91942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f 1073741824 Sep 16 17:40:39 devstack sudo[91942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:40 devstack sudo[91942]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f 1073741824" returned: 0 in 0.793s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:40 devstack sudo[91948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f Sep 16 17:40:40 devstack sudo[91948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:40 devstack sudo[91948]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f" returned: 0 in 0.353s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:40:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e18613f-3658-4067-ac3f-f6e6e8696bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-116f1f46-5757-4fe1-9572-3fb93071906f', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0f6811-2043-45f7-9999-9772f86679f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:40 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Volume volume-116f1f46-5757-4fe1-9572-3fb93071906f (116f1f46-5757-4fe1-9572-3fb93071906f): created successfully Sep 16 17:40:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0f6811-2043-45f7-9999-9772f86679f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Flow 'volume_create_manager' (13cebd88-49d4-45f4-91e7-24ee8e0f69da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:40:40 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-da057cdb-2753-47aa-a216-818bdb1b4e29 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Created volume successfully. Sep 16 17:40:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-95a7e181-bd8e-4a76-88fa-caa038c00083 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-95a7e181-bd8e-4a76-88fa-caa038c00083 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:41 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-95a7e181-bd8e-4a76-88fa-caa038c00083 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Creating offline snapshot c4b93d1d-061c-40d6-974a-5ee5049efc71 of volume 116f1f46-5757-4fe1-9572-3fb93071906f {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:40:41 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[037c1af7-71f3-4f72-9f3f-7274ccf2d109]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:40:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-95a7e181-bd8e-4a76-88fa-caa038c00083 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:41 devstack sudo[91952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f Sep 16 17:40:41 devstack sudo[91952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:42 devstack sudo[91952]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-95a7e181-bd8e-4a76-88fa-caa038c00083 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f" returned: 0 in 0.544s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-95a7e181-bd8e-4a76-88fa-caa038c00083 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.c4b93d1d-061c-40d6-974a-5ee5049efc71 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:42 devstack sudo[91957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.c4b93d1d-061c-40d6-974a-5ee5049efc71 1G Sep 16 17:40:42 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:43 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-95a7e181-bd8e-4a76-88fa-caa038c00083 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.c4b93d1d-061c-40d6-974a-5ee5049efc71 1G" returned: 0 in 0.776s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-95a7e181-bd8e-4a76-88fa-caa038c00083 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-116f1f46-5757-4fe1-9572-3fb93071906f -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.c4b93d1d-061c-40d6-974a-5ee5049efc71 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:43 devstack sudo[91963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-116f1f46-5757-4fe1-9572-3fb93071906f -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.c4b93d1d-061c-40d6-974a-5ee5049efc71 Sep 16 17:40:43 devstack sudo[91963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:43 devstack sudo[91963]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-95a7e181-bd8e-4a76-88fa-caa038c00083 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-116f1f46-5757-4fe1-9572-3fb93071906f -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.c4b93d1d-061c-40d6-974a-5ee5049efc71" returned: 0 in 0.410s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:43 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-95a7e181-bd8e-4a76-88fa-caa038c00083 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.c4b93d1d-061c-40d6-974a-5ee5049efc71 is being set with open permissions: ugo+rw Sep 16 17:40:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-95a7e181-bd8e-4a76-88fa-caa038c00083 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.c4b93d1d-061c-40d6-974a-5ee5049efc71 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:43 devstack sudo[91975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.c4b93d1d-061c-40d6-974a-5ee5049efc71 Sep 16 17:40:43 devstack sudo[91975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:43 devstack sudo[91975]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-95a7e181-bd8e-4a76-88fa-caa038c00083 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.c4b93d1d-061c-40d6-974a-5ee5049efc71" returned: 0 in 0.321s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-95a7e181-bd8e-4a76-88fa-caa038c00083 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:43 devstack sudo[91978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.info Sep 16 17:40:43 devstack sudo[91978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:44 devstack sudo[91978]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-95a7e181-bd8e-4a76-88fa-caa038c00083 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.info" returned: 0 in 0.316s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:44 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-95a7e181-bd8e-4a76-88fa-caa038c00083 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.info is being set with open permissions: ugo+rw Sep 16 17:40:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-95a7e181-bd8e-4a76-88fa-caa038c00083 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:44 devstack sudo[91981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.info Sep 16 17:40:44 devstack sudo[91981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:44 devstack sudo[91981]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-95a7e181-bd8e-4a76-88fa-caa038c00083 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.info" returned: 0 in 0.599s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-95a7e181-bd8e-4a76-88fa-caa038c00083 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.102s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:44 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-95a7e181-bd8e-4a76-88fa-caa038c00083 tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Create snapshot completed successfully Sep 16 17:40:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4b30f1f9-0626-4b50-9615-8cc107c6be3e tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Acquiring lock "cinder-c4b93d1d-061c-40d6-974a-5ee5049efc71-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:40:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4b30f1f9-0626-4b50-9615-8cc107c6be3e tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Lock "cinder-c4b93d1d-061c-40d6-974a-5ee5049efc71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:40:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4b30f1f9-0626-4b50-9615-8cc107c6be3e tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Acquiring lock "cinder-quobyte-116f1f46-5757-4fe1-9572-3fb93071906f" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:40:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4b30f1f9-0626-4b50-9615-8cc107c6be3e tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Lock "cinder-quobyte-116f1f46-5757-4fe1-9572-3fb93071906f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:40:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4b30f1f9-0626-4b50-9615-8cc107c6be3e tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Acquiring lock "cinder-quobyte-c4b93d1d-061c-40d6-974a-5ee5049efc71" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:40:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4b30f1f9-0626-4b50-9615-8cc107c6be3e tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Lock "cinder-quobyte-c4b93d1d-061c-40d6-974a-5ee5049efc71" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:40:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-4b30f1f9-0626-4b50-9615-8cc107c6be3e tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Deleting offline snapshot c4b93d1d-061c-40d6-974a-5ee5049efc71 of volume 116f1f46-5757-4fe1-9572-3fb93071906f {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:40:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-4b30f1f9-0626-4b50-9615-8cc107c6be3e tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] snapshot_file for this snap is: volume-116f1f46-5757-4fe1-9572-3fb93071906f.c4b93d1d-061c-40d6-974a-5ee5049efc71 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:40:46 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[132a06ad-5ee4-4e4b-8cb6-35367c765a63]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:40:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4b30f1f9-0626-4b50-9615-8cc107c6be3e tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.c4b93d1d-061c-40d6-974a-5ee5049efc71 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:46 devstack sudo[91984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.c4b93d1d-061c-40d6-974a-5ee5049efc71 Sep 16 17:40:46 devstack sudo[91984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:47 devstack sudo[91984]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4b30f1f9-0626-4b50-9615-8cc107c6be3e tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.c4b93d1d-061c-40d6-974a-5ee5049efc71" returned: 0 in 0.615s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-4b30f1f9-0626-4b50-9615-8cc107c6be3e tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-116f1f46-5757-4fe1-9572-3fb93071906f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:40:47 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99752a1-1119-42de-a4ef-b3bca827a912]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:40:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4b30f1f9-0626-4b50-9615-8cc107c6be3e tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:47 devstack sudo[91989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f Sep 16 17:40:47 devstack sudo[91989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:47 devstack sudo[91989]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4b30f1f9-0626-4b50-9615-8cc107c6be3e tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f" returned: 0 in 0.551s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4b30f1f9-0626-4b50-9615-8cc107c6be3e tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.c4b93d1d-061c-40d6-974a-5ee5049efc71 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:47 devstack sudo[92018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.c4b93d1d-061c-40d6-974a-5ee5049efc71 Sep 16 17:40:47 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Flow 'volume_create_manager' (d9e0a7a4-65bd-4bb9-8561-c1e8bcd18c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e09100-a48e-46d6-9ebb-89772597b907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e09100-a48e-46d6-9ebb-89772597b907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2005097271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba04848b9a34af0bc5904c0085ae3b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:40:48Z,use_quota=True,user_id='a9f608ea895f423fb42fba832e296bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f111d135-deb5-455d-b0cd-3b11838558e8),volume_type_id=f111d135-deb5-455d-b0cd-3b11838558e8)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4261e761-eb17-4366-8363-e9fd06e95b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4261e761-eb17-4366-8363-e9fd06e95b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ed0135-715b-434f-a6df-c9ee0dd9c02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ed0135-715b-434f-a6df-c9ee0dd9c02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc', 'volume_name': 'volume-835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be847bd-828c-408e-8e2c-113abe4fc7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be847bd-828c-408e-8e2c-113abe4fc7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a11add06-2b19-4f6c-bdb1-e9c5279b9dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:48 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Volume 835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc', 'volume_size': 1} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2005097271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba04848b9a34af0bc5904c0085ae3b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:40:48Z,use_quota=True,user_id='a9f608ea895f423fb42fba832e296bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f111d135-deb5-455d-b0cd-3b11838558e8),volume_type_id=f111d135-deb5-455d-b0cd-3b11838558e8)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Creating volume 835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:40:48 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:48 devstack sudo[92020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc 1073741824 Sep 16 17:40:48 devstack sudo[92020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:48 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4b30f1f9-0626-4b50-9615-8cc107c6be3e tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.c4b93d1d-061c-40d6-974a-5ee5049efc71" returned: 0 in 0.547s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4b30f1f9-0626-4b50-9615-8cc107c6be3e tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.c4b93d1d-061c-40d6-974a-5ee5049efc71 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:48 devstack sudo[92025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.c4b93d1d-061c-40d6-974a-5ee5049efc71 Sep 16 17:40:48 devstack sudo[92025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:48 devstack sudo[92025]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4b30f1f9-0626-4b50-9615-8cc107c6be3e tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f.c4b93d1d-061c-40d6-974a-5ee5049efc71" returned: 0 in 0.278s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:48 devstack sudo[92020]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc 1073741824" returned: 0 in 0.525s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4b30f1f9-0626-4b50-9615-8cc107c6be3e tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Lock "cinder-quobyte-c4b93d1d-061c-40d6-974a-5ee5049efc71" released by "_delete_snapshot" :: held 2.151s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4b30f1f9-0626-4b50-9615-8cc107c6be3e tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Lock "cinder-quobyte-116f1f46-5757-4fe1-9572-3fb93071906f" released by "delete_snapshot" :: held 2.191s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:48 devstack cinder-volume[85899]: WARNING cinder.quota [None req-4b30f1f9-0626-4b50-9615-8cc107c6be3e tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:40:48 devstack sudo[92032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc Sep 16 17:40:48 devstack sudo[92032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:48 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-4b30f1f9-0626-4b50-9615-8cc107c6be3e tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Created reservations ['557fa590-a577-4519-b05c-f4c93727935d', '5f82db69-81b8-4819-ad6c-fbf6f117af2e', 'eb5f0c01-8642-49e5-b7b1-ecc93ee770d4', 'fc5cd99b-eaa2-4f40-8559-fdaf0cf04094'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:40:49 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-4b30f1f9-0626-4b50-9615-8cc107c6be3e tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Delete snapshot completed successfully. Sep 16 17:40:49 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4b30f1f9-0626-4b50-9615-8cc107c6be3e tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Lock "cinder-c4b93d1d-061c-40d6-974a-5ee5049efc71-delete_snapshot" released by "delete_snapshot" :: held 2.385s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:49 devstack sudo[92032]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc" returned: 0 in 0.315s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:40:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a11add06-2b19-4f6c-bdb1-e9c5279b9dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035431f9-61e9-4813-ab48-fff9bd58d177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:49 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Volume volume-835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc (835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc): created successfully Sep 16 17:40:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035431f9-61e9-4813-ab48-fff9bd58d177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Flow 'volume_create_manager' (d9e0a7a4-65bd-4bb9-8561-c1e8bcd18c87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:40:49 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-b17d0c58-c314-4ba2-b9f9-7238095e3ea9 tempest-VolumeTypesAccessTest-719329999 None] Created volume successfully. Sep 16 17:40:49 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ea8c5952-8edc-4445-b944-4ecebc6b1f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Acquiring lock "cinder-116f1f46-5757-4fe1-9572-3fb93071906f-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:40:49 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ea8c5952-8edc-4445-b944-4ecebc6b1f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Lock "cinder-116f1f46-5757-4fe1-9572-3fb93071906f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:40:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ea8c5952-8edc-4445-b944-4ecebc6b1f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Acquiring lock "cinder-quobyte-116f1f46-5757-4fe1-9572-3fb93071906f" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:40:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ea8c5952-8edc-4445-b944-4ecebc6b1f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Lock "cinder-quobyte-116f1f46-5757-4fe1-9572-3fb93071906f" acquired by "delete_volume" :: waited 0.031s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:40:50 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2430dbfd-3f77-41d6-be65-f26edb46999e]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:40:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ea8c5952-8edc-4445-b944-4ecebc6b1f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:50 devstack sudo[92035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f Sep 16 17:40:50 devstack sudo[92035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-045db0fd-beaa-4f5c-b33e-a9dae1fce9aa tempest-VolumeTypesAccessTest-719329999 None] Acquiring lock "cinder-835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:40:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-045db0fd-beaa-4f5c-b33e-a9dae1fce9aa tempest-VolumeTypesAccessTest-719329999 None] Lock "cinder-835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:40:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-045db0fd-beaa-4f5c-b33e-a9dae1fce9aa tempest-VolumeTypesAccessTest-719329999 None] Acquiring lock "cinder-quobyte-835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:40:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-045db0fd-beaa-4f5c-b33e-a9dae1fce9aa tempest-VolumeTypesAccessTest-719329999 None] Lock "cinder-quobyte-835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc" acquired by "delete_volume" :: waited 0.026s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:40:50 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3317fb-bceb-4b51-ad42-a7903c61621e]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:40:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-045db0fd-beaa-4f5c-b33e-a9dae1fce9aa tempest-VolumeTypesAccessTest-719329999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:50 devstack sudo[92035]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ea8c5952-8edc-4445-b944-4ecebc6b1f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f" returned: 0 in 0.481s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ea8c5952-8edc-4445-b944-4ecebc6b1f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:50 devstack sudo[92042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f Sep 16 17:40:50 devstack sudo[92042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:50 devstack sudo[92041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc Sep 16 17:40:50 devstack sudo[92041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:50 devstack sudo[92042]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ea8c5952-8edc-4445-b944-4ecebc6b1f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-116f1f46-5757-4fe1-9572-3fb93071906f" returned: 0 in 0.268s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ea8c5952-8edc-4445-b944-4ecebc6b1f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Lock "cinder-quobyte-116f1f46-5757-4fe1-9572-3fb93071906f" released by "delete_volume" :: held 0.828s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:50 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-ea8c5952-8edc-4445-b944-4ecebc6b1f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Created reservations ['11e7596d-95d6-4a87-b40a-04e92f891247', 'a835153e-bce7-4c8d-9b4f-9935957401b0', '866f1c96-bf56-43ec-a25b-8452f3cae0dd', 'bb85c0b0-7427-4118-8a4d-031d90f5d889'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:40:50 devstack sudo[92041]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-045db0fd-beaa-4f5c-b33e-a9dae1fce9aa tempest-VolumeTypesAccessTest-719329999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc" returned: 0 in 0.416s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-045db0fd-beaa-4f5c-b33e-a9dae1fce9aa tempest-VolumeTypesAccessTest-719329999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:50 devstack sudo[92049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc Sep 16 17:40:50 devstack sudo[92049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ea8c5952-8edc-4445-b944-4ecebc6b1f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ea8c5952-8edc-4445-b944-4ecebc6b1f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ea8c5952-8edc-4445-b944-4ecebc6b1f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:40:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ea8c5952-8edc-4445-b944-4ecebc6b1f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:40:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ea8c5952-8edc-4445-b944-4ecebc6b1f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ea8c5952-8edc-4445-b944-4ecebc6b1f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:51 devstack sudo[92051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:40:51 devstack sudo[92051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:51 devstack sudo[92049]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-045db0fd-beaa-4f5c-b33e-a9dae1fce9aa tempest-VolumeTypesAccessTest-719329999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc" returned: 0 in 0.286s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-045db0fd-beaa-4f5c-b33e-a9dae1fce9aa tempest-VolumeTypesAccessTest-719329999 None] Lock "cinder-quobyte-835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc" released by "delete_volume" :: held 0.783s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:51 devstack cinder-volume[85899]: WARNING cinder.quota [None req-045db0fd-beaa-4f5c-b33e-a9dae1fce9aa tempest-VolumeTypesAccessTest-719329999 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-551012011 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-551012011, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:40:51 devstack cinder-volume[85899]: WARNING cinder.quota [None req-045db0fd-beaa-4f5c-b33e-a9dae1fce9aa tempest-VolumeTypesAccessTest-719329999 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-551012011 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-551012011, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:40:51 devstack sudo[92051]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ea8c5952-8edc-4445-b944-4ecebc6b1f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.304s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:51 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-ea8c5952-8edc-4445-b944-4ecebc6b1f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:40:51 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-045db0fd-beaa-4f5c-b33e-a9dae1fce9aa tempest-VolumeTypesAccessTest-719329999 None] Created reservations ['bb8404d9-c29f-487d-9335-cf4fad5f7e6f', '76bab32e-e407-4580-a505-7e8ce165ef0d', '9ee02a00-759a-4dfe-a5ca-67ef7df4f1af', '0e5cf9b2-63a2-46df-90ea-9bb6b27c0745'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:40:51 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-ea8c5952-8edc-4445-b944-4ecebc6b1f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Deleted volume successfully. Sep 16 17:40:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ea8c5952-8edc-4445-b944-4ecebc6b1f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-46809758 None] Lock "cinder-116f1f46-5757-4fe1-9572-3fb93071906f-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-045db0fd-beaa-4f5c-b33e-a9dae1fce9aa tempest-VolumeTypesAccessTest-719329999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-045db0fd-beaa-4f5c-b33e-a9dae1fce9aa tempest-VolumeTypesAccessTest-719329999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-045db0fd-beaa-4f5c-b33e-a9dae1fce9aa tempest-VolumeTypesAccessTest-719329999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:40:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-045db0fd-beaa-4f5c-b33e-a9dae1fce9aa tempest-VolumeTypesAccessTest-719329999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:40:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-045db0fd-beaa-4f5c-b33e-a9dae1fce9aa tempest-VolumeTypesAccessTest-719329999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-045db0fd-beaa-4f5c-b33e-a9dae1fce9aa tempest-VolumeTypesAccessTest-719329999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:51 devstack sudo[92055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:40:51 devstack sudo[92055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:40:51 devstack sudo[92055]: pam_unix(sudo:session): session closed for user root Sep 16 17:40:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-045db0fd-beaa-4f5c-b33e-a9dae1fce9aa tempest-VolumeTypesAccessTest-719329999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.505s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:40:51 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-045db0fd-beaa-4f5c-b33e-a9dae1fce9aa tempest-VolumeTypesAccessTest-719329999 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:40:51 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-045db0fd-beaa-4f5c-b33e-a9dae1fce9aa tempest-VolumeTypesAccessTest-719329999 None] Deleted volume successfully. Sep 16 17:40:52 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-045db0fd-beaa-4f5c-b33e-a9dae1fce9aa tempest-VolumeTypesAccessTest-719329999 None] Lock "cinder-835ca0f1-ec2c-48cd-b272-8e2dcc8f78cc-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:40:59 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:40:59 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Flow 'volume_create_manager' (ef4aab82-9269-4459-8848-05c369cb7e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:40:59 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5b719d-603c-4c20-ab35-0e9d44e693a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:59 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5b719d-603c-4c20-ab35-0e9d44e693a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-83663108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5888613e-dd40-4381-aba8-8a730d386527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6169b1cad434069b6f65ebc3dab5bdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:40:59Z,use_quota=True,user_id='0bb5fa0ec19c4c55ba0bd57b2fc2c9d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:59 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dcd8008-d46b-41eb-913e-27b36788b467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:59 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dcd8008-d46b-41eb-913e-27b36788b467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:59 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d897a9-e2c8-4573-935f-c905b454e573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:59 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d897a9-e2c8-4573-935f-c905b454e573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5888613e-dd40-4381-aba8-8a730d386527', 'volume_name': 'volume-5888613e-dd40-4381-aba8-8a730d386527', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:59 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebdbb62-b2f6-43ee-a6c1-8d36f4c480fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:59 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebdbb62-b2f6-43ee-a6c1-8d36f4c480fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:40:59 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8ef4b4-75fc-4a9d-ad6c-afa8448e5ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:40:59 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Volume 5888613e-dd40-4381-aba8-8a730d386527: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5888613e-dd40-4381-aba8-8a730d386527', 'volume_size': 1} Sep 16 17:40:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:59 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-83663108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5888613e-dd40-4381-aba8-8a730d386527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6169b1cad434069b6f65ebc3dab5bdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:40:59Z,use_quota=True,user_id='0bb5fa0ec19c4c55ba0bd57b2fc2c9d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:40:59 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Creating volume 5888613e-dd40-4381-aba8-8a730d386527 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:40:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:40:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:40:59 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:40:59 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:40:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:40:59 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:40:59 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:40:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5888613e-dd40-4381-aba8-8a730d386527 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:40:59 devstack sudo[92068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5888613e-dd40-4381-aba8-8a730d386527 1073741824 Sep 16 17:40:59 devstack sudo[92068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:00 devstack sudo[92068]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5888613e-dd40-4381-aba8-8a730d386527 1073741824" returned: 0 in 0.764s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5888613e-dd40-4381-aba8-8a730d386527 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:00 devstack sudo[92087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5888613e-dd40-4381-aba8-8a730d386527 Sep 16 17:41:00 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:00 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5888613e-dd40-4381-aba8-8a730d386527" returned: 0 in 0.302s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:41:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8ef4b4-75fc-4a9d-ad6c-afa8448e5ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5888613e-dd40-4381-aba8-8a730d386527', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1392f6f-1629-4aab-82bb-4e3a78275fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:00 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Volume volume-5888613e-dd40-4381-aba8-8a730d386527 (5888613e-dd40-4381-aba8-8a730d386527): created successfully Sep 16 17:41:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1392f6f-1629-4aab-82bb-4e3a78275fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Flow 'volume_create_manager' (ef4aab82-9269-4459-8848-05c369cb7e60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:41:00 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-bcdd93f9-4af2-45ba-9546-c0831524200b tempest-AttachVolumeNegativeTest-195502489 None] Created volume successfully. Sep 16 17:41:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:41:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:41:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:41:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:02 devstack sudo[92098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:41:02 devstack sudo[92098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-aeafd029-1ca4-4c76-8148-f62588020cc7 req-d8f67d8f-6d18-467f-8bc4-f736eabf4684 tempest-AttachVolumeNegativeTest-195502489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-aeafd029-1ca4-4c76-8148-f62588020cc7 req-d8f67d8f-6d18-467f-8bc4-f736eabf4684 tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-aeafd029-1ca4-4c76-8148-f62588020cc7 req-d8f67d8f-6d18-467f-8bc4-f736eabf4684 tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-aeafd029-1ca4-4c76-8148-f62588020cc7 req-d8f67d8f-6d18-467f-8bc4-f736eabf4684 tempest-AttachVolumeNegativeTest-195502489 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7', 'name': 'volume-5888613e-dd40-4381-aba8-8a730d386527', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c23fdd0f-7e8d-4b1f-9184-cfd4168776a8', 'enforce_multipath': True} {{(pid=85899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4920}} Sep 16 17:41:02 devstack sudo[92098]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.443s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:41:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager._thread_info {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:41:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread count: 28 {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:41:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread info: [<_MainThread(MainThread, started 123748124422272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:41:02 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-aeafd029-1ca4-4c76-8148-f62588020cc7 req-d8f67d8f-6d18-467f-8bc4-f736eabf4684 tempest-AttachVolumeNegativeTest-195502489 None] attachment_update completed successfully. Sep 16 17:41:06 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:41:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Flow 'volume_create_manager' (7c68761b-14f3-4380-9dcc-dc1d79c05c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:41:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb95442-c589-49cc-a126-9bcc67681ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb95442-c589-49cc-a126-9bcc67681ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1772341849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af87c9c3-5360-4d48-9ccf-d04351576cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d218115e859548bfade3d296d2de7f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:41:06Z,use_quota=True,user_id='44ec77f991dc43e59d1bf2258ed8668f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0467fd7-7e55-43f1-81fe-502e1ae759ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0467fd7-7e55-43f1-81fe-502e1ae759ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff52244e-3a62-411b-8688-2009adcd4b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff52244e-3a62-411b-8688-2009adcd4b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af87c9c3-5360-4d48-9ccf-d04351576cca', 'volume_name': 'volume-af87c9c3-5360-4d48-9ccf-d04351576cca', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd39f98-430a-47a7-af88-4f1af0be5df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd39f98-430a-47a7-af88-4f1af0be5df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ffbb89-7de3-4eac-be74-09b3a3b4eeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:06 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Volume af87c9c3-5360-4d48-9ccf-d04351576cca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af87c9c3-5360-4d48-9ccf-d04351576cca', 'volume_size': 1} Sep 16 17:41:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:06 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1772341849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af87c9c3-5360-4d48-9ccf-d04351576cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d218115e859548bfade3d296d2de7f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:41:06Z,use_quota=True,user_id='44ec77f991dc43e59d1bf2258ed8668f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:41:06 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Creating volume af87c9c3-5360-4d48-9ccf-d04351576cca {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:41:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:06 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:41:06 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:41:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:06 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:41:06 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:41:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:06 devstack sudo[92590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca 1073741824 Sep 16 17:41:06 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:06 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca 1073741824" returned: 0 in 0.725s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:07 devstack sudo[92625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca Sep 16 17:41:07 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:07 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-c1dc3315-b0cf-4d24-b112-506f39a40b6f req-1d5971b0-e788-41b9-bfd9-7729474ab9c5 tempest-AttachVolumeNegativeTest-195502489 None] Terminate volume connection completed successfully. Sep 16 17:41:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-c1dc3315-b0cf-4d24-b112-506f39a40b6f req-1d5971b0-e788-41b9-bfd9-7729474ab9c5 tempest-AttachVolumeNegativeTest-195502489 None] Deleting attachment c23fdd0f-7e8d-4b1f-9184-cfd4168776a8. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:41:07 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca" returned: 0 in 0.400s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:07 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:41:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ffbb89-7de3-4eac-be74-09b3a3b4eeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af87c9c3-5360-4d48-9ccf-d04351576cca', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1883fedc-12a0-4a0c-b426-9501be8fddf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:07 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Volume volume-af87c9c3-5360-4d48-9ccf-d04351576cca (af87c9c3-5360-4d48-9ccf-d04351576cca): created successfully Sep 16 17:41:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1883fedc-12a0-4a0c-b426-9501be8fddf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Flow 'volume_create_manager' (7c68761b-14f3-4380-9dcc-dc1d79c05c86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:41:07 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-e24d15c3-1419-48f5-a661-c90b7843a957 tempest-VolumesDeleteCascade-396871994 None] Created volume successfully. Sep 16 17:41:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5f0819a8-311e-481b-8696-778bb70f4aee tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5f0819a8-311e-481b-8696-778bb70f4aee tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5f0819a8-311e-481b-8696-778bb70f4aee tempest-VolumesDeleteCascade-396871994 None] Creating offline snapshot 3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf of volume af87c9c3-5360-4d48-9ccf-d04351576cca {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:41:09 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb275f32-947a-4748-96ee-b982b51093df]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f0819a8-311e-481b-8696-778bb70f4aee tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:09 devstack sudo[92650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca Sep 16 17:41:09 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:09 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f0819a8-311e-481b-8696-778bb70f4aee tempest-VolumesDeleteCascade-396871994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca" returned: 0 in 0.783s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f0819a8-311e-481b-8696-778bb70f4aee tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:10 devstack sudo[92655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf 1G Sep 16 17:41:10 devstack sudo[92655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:10 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:41:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Flow 'volume_create_manager' (baa367e4-3549-4d1a-b715-eaa4cb69a5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:41:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0257033-03d4-4b8a-9641-f0b1f5bb9721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0257033-03d4-4b8a-9641-f0b1f5bb9721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1588418681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed6d477-7fc3-445e-989c-e887de0ef98e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939f7d6cbf704038beed2b1c768ad395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:41:10Z,use_quota=True,user_id='8b1d80bc0a534385a83b044839d9792e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d705399-2567-4a93-b5f5-9a9206a6bab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d705399-2567-4a93-b5f5-9a9206a6bab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1188ef46-2d95-4f89-920a-1dbb9e50cf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1188ef46-2d95-4f89-920a-1dbb9e50cf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed6d477-7fc3-445e-989c-e887de0ef98e', 'volume_name': 'volume-eed6d477-7fc3-445e-989c-e887de0ef98e', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ed929e-b96f-40e1-8965-966a6cfa4b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ed929e-b96f-40e1-8965-966a6cfa4b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed66e1b-9633-4761-9b44-efc2090c2957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:10 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Volume eed6d477-7fc3-445e-989c-e887de0ef98e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed6d477-7fc3-445e-989c-e887de0ef98e', 'volume_size': 1} Sep 16 17:41:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:10 devstack sudo[92655]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f0819a8-311e-481b-8696-778bb70f4aee tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf 1G" returned: 0 in 0.566s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f0819a8-311e-481b-8696-778bb70f4aee tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af87c9c3-5360-4d48-9ccf-d04351576cca -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:10 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af87c9c3-5360-4d48-9ccf-d04351576cca -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf Sep 16 17:41:10 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:10 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f0819a8-311e-481b-8696-778bb70f4aee tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af87c9c3-5360-4d48-9ccf-d04351576cca -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf" returned: 0 in 0.406s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:10 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-5f0819a8-311e-481b-8696-778bb70f4aee tempest-VolumesDeleteCascade-396871994 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf is being set with open permissions: ugo+rw Sep 16 17:41:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f0819a8-311e-481b-8696-778bb70f4aee tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:11 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf Sep 16 17:41:11 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:11 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f0819a8-311e-481b-8696-778bb70f4aee tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf" returned: 0 in 0.377s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f0819a8-311e-481b-8696-778bb70f4aee tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:11 devstack sudo[92685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.info Sep 16 17:41:11 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:11 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f0819a8-311e-481b-8696-778bb70f4aee tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.info" returned: 0 in 0.588s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:11 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-5f0819a8-311e-481b-8696-778bb70f4aee tempest-VolumesDeleteCascade-396871994 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.info is being set with open permissions: ugo+rw Sep 16 17:41:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f0819a8-311e-481b-8696-778bb70f4aee tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:12 devstack sudo[92689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.info Sep 16 17:41:12 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:12 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f0819a8-311e-481b-8696-778bb70f4aee tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.info" returned: 0 in 0.452s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5f0819a8-311e-481b-8696-778bb70f4aee tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.330s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.154s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:12 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1588418681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed6d477-7fc3-445e-989c-e887de0ef98e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939f7d6cbf704038beed2b1c768ad395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:41:10Z,use_quota=True,user_id='8b1d80bc0a534385a83b044839d9792e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:41:12 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Creating volume eed6d477-7fc3-445e-989c-e887de0ef98e {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:41:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:12 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:41:12 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:41:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:12 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:41:12 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:41:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eed6d477-7fc3-445e-989c-e887de0ef98e 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:12 devstack sudo[92692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eed6d477-7fc3-445e-989c-e887de0ef98e 1073741824 Sep 16 17:41:12 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:12 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5f0819a8-311e-481b-8696-778bb70f4aee tempest-VolumesDeleteCascade-396871994 None] Create snapshot completed successfully Sep 16 17:41:12 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eed6d477-7fc3-445e-989c-e887de0ef98e 1073741824" returned: 0 in 0.496s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eed6d477-7fc3-445e-989c-e887de0ef98e {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:13 devstack sudo[92698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eed6d477-7fc3-445e-989c-e887de0ef98e Sep 16 17:41:13 devstack sudo[92698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:13 devstack sudo[92698]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eed6d477-7fc3-445e-989c-e887de0ef98e" returned: 0 in 0.321s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:13 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:41:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:13 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed66e1b-9633-4761-9b44-efc2090c2957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed6d477-7fc3-445e-989c-e887de0ef98e', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:13 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671d48da-af15-4833-a2ac-da1847d7f95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:13 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Volume volume-eed6d477-7fc3-445e-989c-e887de0ef98e (eed6d477-7fc3-445e-989c-e887de0ef98e): created successfully Sep 16 17:41:13 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671d48da-af15-4833-a2ac-da1847d7f95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:13 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Flow 'volume_create_manager' (baa367e4-3549-4d1a-b715-eaa4cb69a5b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:41:13 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-77f2315f-d0b6-46ef-903f-40a57fb09ce9 tempest-AbsoluteLimitsTests-753588180 None] Created volume successfully. Sep 16 17:41:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fd12a97a-df22-4b9c-b8e3-28a9cd423e1b tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fd12a97a-df22-4b9c-b8e3-28a9cd423e1b tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:13 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-fd12a97a-df22-4b9c-b8e3-28a9cd423e1b tempest-VolumesDeleteCascade-396871994 None] Creating offline snapshot 932ac867-f83a-43bf-84fa-ed25c07e0dd0 of volume af87c9c3-5360-4d48-9ccf-d04351576cca {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:41:13 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed67e702-2d70-4634-8305-a520bd1ef73e]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fd12a97a-df22-4b9c-b8e3-28a9cd423e1b tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:13 devstack sudo[92701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf Sep 16 17:41:13 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:14 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fd12a97a-df22-4b9c-b8e3-28a9cd423e1b tempest-VolumesDeleteCascade-396871994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf" returned: 0 in 0.385s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-fd12a97a-df22-4b9c-b8e3-28a9cd423e1b tempest-VolumesDeleteCascade-396871994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af87c9c3-5360-4d48-9ccf-d04351576cca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:41:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fd12a97a-df22-4b9c-b8e3-28a9cd423e1b tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:14 devstack sudo[92706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0 1G Sep 16 17:41:14 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:14 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-84d49fa7-2680-46b8-9521-af5fd7652182 tempest-AbsoluteLimitsTests-753588180 None] Acquiring lock "cinder-eed6d477-7fc3-445e-989c-e887de0ef98e-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:41:14 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-84d49fa7-2680-46b8-9521-af5fd7652182 tempest-AbsoluteLimitsTests-753588180 None] Lock "cinder-eed6d477-7fc3-445e-989c-e887de0ef98e-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:41:14 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-84d49fa7-2680-46b8-9521-af5fd7652182 tempest-AbsoluteLimitsTests-753588180 None] Acquiring lock "cinder-quobyte-eed6d477-7fc3-445e-989c-e887de0ef98e" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:41:14 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-84d49fa7-2680-46b8-9521-af5fd7652182 tempest-AbsoluteLimitsTests-753588180 None] Lock "cinder-quobyte-eed6d477-7fc3-445e-989c-e887de0ef98e" acquired by "delete_volume" :: waited 0.032s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:41:14 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a998bef-2b3a-42f1-abf4-4cfd480b65d9]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-84d49fa7-2680-46b8-9521-af5fd7652182 tempest-AbsoluteLimitsTests-753588180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eed6d477-7fc3-445e-989c-e887de0ef98e {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:15 devstack sudo[92712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eed6d477-7fc3-445e-989c-e887de0ef98e Sep 16 17:41:15 devstack sudo[92712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:15 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fd12a97a-df22-4b9c-b8e3-28a9cd423e1b tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0 1G" returned: 0 in 0.854s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fd12a97a-df22-4b9c-b8e3-28a9cd423e1b tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:15 devstack sudo[92714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0 Sep 16 17:41:15 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:15 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fd12a97a-df22-4b9c-b8e3-28a9cd423e1b tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0" returned: 0 in 0.376s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:15 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-fd12a97a-df22-4b9c-b8e3-28a9cd423e1b tempest-VolumesDeleteCascade-396871994 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0 is being set with open permissions: ugo+rw Sep 16 17:41:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fd12a97a-df22-4b9c-b8e3-28a9cd423e1b tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:15 devstack sudo[92712]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-84d49fa7-2680-46b8-9521-af5fd7652182 tempest-AbsoluteLimitsTests-753588180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eed6d477-7fc3-445e-989c-e887de0ef98e" returned: 0 in 0.534s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-84d49fa7-2680-46b8-9521-af5fd7652182 tempest-AbsoluteLimitsTests-753588180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eed6d477-7fc3-445e-989c-e887de0ef98e {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:15 devstack sudo[92724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0 Sep 16 17:41:15 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:15 devstack sudo[92725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eed6d477-7fc3-445e-989c-e887de0ef98e Sep 16 17:41:15 devstack sudo[92725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:15 devstack sudo[92725]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-84d49fa7-2680-46b8-9521-af5fd7652182 tempest-AbsoluteLimitsTests-753588180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-eed6d477-7fc3-445e-989c-e887de0ef98e" returned: 0 in 0.328s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:15 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-84d49fa7-2680-46b8-9521-af5fd7652182 tempest-AbsoluteLimitsTests-753588180 None] Lock "cinder-quobyte-eed6d477-7fc3-445e-989c-e887de0ef98e" released by "delete_volume" :: held 0.932s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:41:15 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fd12a97a-df22-4b9c-b8e3-28a9cd423e1b tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0" returned: 0 in 0.395s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fd12a97a-df22-4b9c-b8e3-28a9cd423e1b tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.163s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:15 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-fd12a97a-df22-4b9c-b8e3-28a9cd423e1b tempest-VolumesDeleteCascade-396871994 None] Create snapshot completed successfully Sep 16 17:41:15 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-84d49fa7-2680-46b8-9521-af5fd7652182 tempest-AbsoluteLimitsTests-753588180 None] Created reservations ['ea3eb80e-1cfe-4fa0-bce9-5ccee81d7c42', 'dfbbd2f2-6f95-43b7-aa36-f5ed423fac2b', '91587d23-67f5-4ce1-93c1-24e4e4d4024a', '0cd3b4f8-e159-4f80-87c5-8f09d0a0c4bf'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:41:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-84d49fa7-2680-46b8-9521-af5fd7652182 tempest-AbsoluteLimitsTests-753588180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-84d49fa7-2680-46b8-9521-af5fd7652182 tempest-AbsoluteLimitsTests-753588180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:16 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-84d49fa7-2680-46b8-9521-af5fd7652182 tempest-AbsoluteLimitsTests-753588180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:41:16 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-84d49fa7-2680-46b8-9521-af5fd7652182 tempest-AbsoluteLimitsTests-753588180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:41:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-84d49fa7-2680-46b8-9521-af5fd7652182 tempest-AbsoluteLimitsTests-753588180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-84d49fa7-2680-46b8-9521-af5fd7652182 tempest-AbsoluteLimitsTests-753588180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:16 devstack sudo[92730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:41:16 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:16 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-84d49fa7-2680-46b8-9521-af5fd7652182 tempest-AbsoluteLimitsTests-753588180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.282s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:16 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-84d49fa7-2680-46b8-9521-af5fd7652182 tempest-AbsoluteLimitsTests-753588180 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:41:16 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-84d49fa7-2680-46b8-9521-af5fd7652182 tempest-AbsoluteLimitsTests-753588180 None] Deleted volume successfully. Sep 16 17:41:16 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-84d49fa7-2680-46b8-9521-af5fd7652182 tempest-AbsoluteLimitsTests-753588180 None] Lock "cinder-eed6d477-7fc3-445e-989c-e887de0ef98e-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:41:16 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "cinder-af87c9c3-5360-4d48-9ccf-d04351576cca-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:41:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-af87c9c3-5360-4d48-9ccf-d04351576cca-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:41:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Performing cascade delete. {{(pid=85899) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 16 17:41:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "cinder-3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:41:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:41:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "cinder-quobyte-af87c9c3-5360-4d48-9ccf-d04351576cca" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:41:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-quobyte-af87c9c3-5360-4d48-9ccf-d04351576cca" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:41:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "cinder-quobyte-3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:41:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-quobyte-3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:41:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Deleting offline snapshot 3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf of volume af87c9c3-5360-4d48-9ccf-d04351576cca {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:41:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] snapshot_file for this snap is: volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:41:17 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a27a125-5e94-4c7f-9c3b-605fb3335ba7]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:17 devstack sudo[92733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf Sep 16 17:41:17 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:17 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf" returned: 0 in 0.515s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af87c9c3-5360-4d48-9ccf-d04351576cca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:41:17 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cefe25-148e-4f22-a6de-26a6b69e56a1]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:17 devstack sudo[92754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca Sep 16 17:41:17 devstack sudo[92754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:18 devstack sudo[92754]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca" returned: 0 in 0.482s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:18 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df734aa-4093-45c3-a85d-4e2f12acc966]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:18 devstack sudo[92762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0 Sep 16 17:41:18 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:18 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0" returned: 0 in 0.481s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af87c9c3-5360-4d48-9ccf-d04351576cca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:41:18 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[494b1069-3fa6-4dd1-8c52-eff8b14ad889]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:18 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf Sep 16 17:41:18 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:19 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf" returned: 0 in 0.433s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:19 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af87c9c3-5360-4d48-9ccf-d04351576cca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:41:19 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd772b2-ca5e-4531-a598-1b5de2f37bed]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:19 devstack sudo[92773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca Sep 16 17:41:19 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:19 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca" returned: 0 in 0.481s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:19 devstack sudo[92778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf Sep 16 17:41:19 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:20 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf" returned: 0 in 0.601s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:20 devstack sudo[92789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf Sep 16 17:41:20 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:20 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf" returned: 0 in 0.373s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af87c9c3-5360-4d48-9ccf-d04351576cca /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0 -F qcow2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:20 devstack sudo[92802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af87c9c3-5360-4d48-9ccf-d04351576cca /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0 -F qcow2 Sep 16 17:41:20 devstack sudo[92802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:21 devstack sudo[92802]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af87c9c3-5360-4d48-9ccf-d04351576cca /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0 -F qcow2" returned: 0 in 0.313s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-quobyte-3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf" released by "_delete_snapshot" :: held 3.942s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:41:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-quobyte-af87c9c3-5360-4d48-9ccf-d04351576cca" released by "delete_snapshot" :: held 3.973s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:41:21 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Created reservations ['17f6a29c-8e91-4ac8-87b5-2a15340d05d9', 'a56de4ce-68b9-4797-8076-ad63e1ad3f34', '3695dfc4-28d4-4825-b14a-ea5bc5178f98', '1ac5a857-da04-48e2-9d34-21bd53ba6f0c'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:41:21 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Delete snapshot completed successfully. Sep 16 17:41:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-3309bb3e-a7de-47e7-99bd-4e7cc3bfdecf-delete_snapshot" released by "delete_snapshot" :: held 4.188s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:41:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "cinder-932ac867-f83a-43bf-84fa-ed25c07e0dd0-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:41:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-932ac867-f83a-43bf-84fa-ed25c07e0dd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:41:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "cinder-quobyte-af87c9c3-5360-4d48-9ccf-d04351576cca" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:41:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-quobyte-af87c9c3-5360-4d48-9ccf-d04351576cca" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:41:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "cinder-quobyte-932ac867-f83a-43bf-84fa-ed25c07e0dd0" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:41:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-quobyte-932ac867-f83a-43bf-84fa-ed25c07e0dd0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:41:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Deleting offline snapshot 932ac867-f83a-43bf-84fa-ed25c07e0dd0 of volume af87c9c3-5360-4d48-9ccf-d04351576cca {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:41:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] snapshot_file for this snap is: volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:41:21 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddf4de5-a4de-409d-8ae5-4d052af67822]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:21 devstack sudo[92809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0 Sep 16 17:41:21 devstack sudo[92809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:21 devstack sudo[92809]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0" returned: 0 in 0.414s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af87c9c3-5360-4d48-9ccf-d04351576cca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:41:21 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ca38c1-72a1-458d-b0cb-65ab4b488469]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:22 devstack sudo[92815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca Sep 16 17:41:22 devstack sudo[92815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:22 devstack sudo[92815]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca" returned: 0 in 0.434s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:22 devstack sudo[92820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0 Sep 16 17:41:22 devstack sudo[92820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:22 devstack sudo[92820]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0" returned: 0 in 0.393s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:22 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0 Sep 16 17:41:22 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:23 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca.932ac867-f83a-43bf-84fa-ed25c07e0dd0" returned: 0 in 0.290s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-quobyte-932ac867-f83a-43bf-84fa-ed25c07e0dd0" released by "_delete_snapshot" :: held 1.706s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:41:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-quobyte-af87c9c3-5360-4d48-9ccf-d04351576cca" released by "delete_snapshot" :: held 1.739s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:41:23 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Created reservations ['8a00a2d6-d4a1-4557-9723-11db3b2e0cee', '7d8a75b0-9e55-4439-ae0f-400dfd89ca2d', 'cfef901e-f100-4240-9660-7ad55ed04a94', '9dd9131a-8d31-41f5-8f04-f9c78e84d72a'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:41:23 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Delete snapshot completed successfully. Sep 16 17:41:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-932ac867-f83a-43bf-84fa-ed25c07e0dd0-delete_snapshot" released by "delete_snapshot" :: held 1.937s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:41:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Snapshots deleted, issuing volume delete {{(pid=85899) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 16 17:41:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "cinder-quobyte-af87c9c3-5360-4d48-9ccf-d04351576cca" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:41:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-quobyte-af87c9c3-5360-4d48-9ccf-d04351576cca" acquired by "delete_volume" :: waited 0.027s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:41:23 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bca0e79-e416-4746-b067-3bdaf4bbc88e]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:23 devstack sudo[92829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca Sep 16 17:41:23 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:24 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca" returned: 0 in 0.636s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:24 devstack sudo[92887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca Sep 16 17:41:24 devstack sudo[92887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:24 devstack sudo[92887]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-af87c9c3-5360-4d48-9ccf-d04351576cca" returned: 0 in 0.448s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-quobyte-af87c9c3-5360-4d48-9ccf-d04351576cca" released by "delete_volume" :: held 1.236s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:41:24 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Created reservations ['eb496df3-7a9e-4582-95cd-99c5e3a7fa9f', '9c7938f8-8dad-4bc7-8f43-828164720c4a', '33c8a466-36f1-4756-8e74-2c2705098f0d', 'd3425a11-0781-4ce6-8955-218a9dadbc54'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:41:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:41:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:41:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:24 devstack sudo[92903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:41:24 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:25 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.330s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:25 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:41:25 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Deleted volume successfully. Sep 16 17:41:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79cfe205-9657-4764-80cc-18ecf0d20a79 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-af87c9c3-5360-4d48-9ccf-d04351576cca-delete_volume" released by "delete_volume" :: held 8.265s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:41:26 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:UPDATE=89,cinder:SELECT=64,cinder:DELETE=7,cinder:INSERT=17 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:41:26 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:41:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Flow 'volume_create_manager' (83735404-184d-40a7-ac35-32d25e43b6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:41:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e64d3a-e1ed-409e-93cc-87e57a6bd9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e64d3a-e1ed-409e-93cc-87e57a6bd9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1167695086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a344ddad-7408-44d9-b6d2-972cfbe56265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c68597f4dd7f44b4a8b724db00687a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:41:26Z,use_quota=True,user_id='360f1167900f4b189c1551aa9b25bd3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b407d9-3191-4db6-a247-8cc6db8cc330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b407d9-3191-4db6-a247-8cc6db8cc330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8632744-c26f-4c01-8438-3be5a17a62b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8632744-c26f-4c01-8438-3be5a17a62b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a344ddad-7408-44d9-b6d2-972cfbe56265', 'volume_name': 'volume-a344ddad-7408-44d9-b6d2-972cfbe56265', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23b6a0f-bffc-493c-a077-d6fc6082b922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23b6a0f-bffc-493c-a077-d6fc6082b922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64dbdc0-96ef-486d-b066-1378fa711726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:26 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Volume a344ddad-7408-44d9-b6d2-972cfbe56265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a344ddad-7408-44d9-b6d2-972cfbe56265', 'volume_size': 1} Sep 16 17:41:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1167695086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a344ddad-7408-44d9-b6d2-972cfbe56265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c68597f4dd7f44b4a8b724db00687a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:41:26Z,use_quota=True,user_id='360f1167900f4b189c1551aa9b25bd3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:41:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Creating volume a344ddad-7408-44d9-b6d2-972cfbe56265 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:41:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:41:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:41:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:41:26 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:41:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a344ddad-7408-44d9-b6d2-972cfbe56265 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:26 devstack sudo[92909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a344ddad-7408-44d9-b6d2-972cfbe56265 1073741824 Sep 16 17:41:26 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Flow 'volume_create_manager' (35a1256b-47b6-4260-9f18-e398299a85ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfec0401-c3f3-48bc-871a-e1c94bac8705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:27 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a344ddad-7408-44d9-b6d2-972cfbe56265 1073741824" returned: 0 in 0.778s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfec0401-c3f3-48bc-871a-e1c94bac8705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1663111746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc309935-f44f-4ab3-9687-8a95c561f394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d218115e859548bfade3d296d2de7f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:41:27Z,use_quota=True,user_id='44ec77f991dc43e59d1bf2258ed8668f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c68fdbb-43d5-47a6-8085-c44040fa1ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c68fdbb-43d5-47a6-8085-c44040fa1ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d846233-2611-4a05-abcc-f0890163368f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d846233-2611-4a05-abcc-f0890163368f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc309935-f44f-4ab3-9687-8a95c561f394', 'volume_name': 'volume-bc309935-f44f-4ab3-9687-8a95c561f394', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df85b9d8-cb64-4c09-a779-cbbe0eea9539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df85b9d8-cb64-4c09-a779-cbbe0eea9539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04134ca-aa96-4adb-863f-d9293f373bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:27 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Volume bc309935-f44f-4ab3-9687-8a95c561f394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc309935-f44f-4ab3-9687-8a95c561f394', 'volume_size': 1} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a344ddad-7408-44d9-b6d2-972cfbe56265 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:27 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a344ddad-7408-44d9-b6d2-972cfbe56265 Sep 16 17:41:27 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:27 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a344ddad-7408-44d9-b6d2-972cfbe56265" returned: 0 in 0.265s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.298s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1663111746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc309935-f44f-4ab3-9687-8a95c561f394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d218115e859548bfade3d296d2de7f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:41:27Z,use_quota=True,user_id='44ec77f991dc43e59d1bf2258ed8668f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Creating volume bc309935-f44f-4ab3-9687-8a95c561f394 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:41:27 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64dbdc0-96ef-486d-b066-1378fa711726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a344ddad-7408-44d9-b6d2-972cfbe56265', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9579b0c8-ebf7-4684-8063-f38fb7979b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:27 devstack sudo[92917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394 1073741824 Sep 16 17:41:27 devstack sudo[92917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:27 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Volume volume-a344ddad-7408-44d9-b6d2-972cfbe56265 (a344ddad-7408-44d9-b6d2-972cfbe56265): created successfully Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9579b0c8-ebf7-4684-8063-f38fb7979b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Flow 'volume_create_manager' (83735404-184d-40a7-ac35-32d25e43b6f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:41:27 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-692512fe-a53f-4c40-ad0c-831dcfe26fbc tempest-VolumesTransfersTest-1387963106 None] Created volume successfully. Sep 16 17:41:28 devstack sudo[92917]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394 1073741824" returned: 0 in 0.532s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:28 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394 Sep 16 17:41:28 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:28 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394" returned: 0 in 0.338s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:41:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04134ca-aa96-4adb-863f-d9293f373bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc309935-f44f-4ab3-9687-8a95c561f394', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ea44d7-1f28-4d2e-8b85-fb2c8e5691e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:28 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Volume volume-bc309935-f44f-4ab3-9687-8a95c561f394 (bc309935-f44f-4ab3-9687-8a95c561f394): created successfully Sep 16 17:41:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ea44d7-1f28-4d2e-8b85-fb2c8e5691e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Flow 'volume_create_manager' (35a1256b-47b6-4260-9f18-e398299a85ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:41:28 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-c6be35fd-bb06-46e4-902c-eb7c9c26b7eb tempest-VolumesDeleteCascade-396871994 None] Created volume successfully. Sep 16 17:41:29 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-2d3c6de4-0195-4a27-8595-c418dc37ef8a tempest-VolumesTransfersTest-755877006 None] Transfer volume completed successfully. Sep 16 17:41:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8a811e46-676b-49f4-b32b-2af6d0316266 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8a811e46-676b-49f4-b32b-2af6d0316266 tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-8a811e46-676b-49f4-b32b-2af6d0316266 tempest-VolumesDeleteCascade-396871994 None] Creating offline snapshot 225dab36-40dc-4f76-b947-2b67eb35fd13 of volume bc309935-f44f-4ab3-9687-8a95c561f394 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:41:29 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[270ac136-e951-4f46-9734-0c11d5e1c9d7]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8a811e46-676b-49f4-b32b-2af6d0316266 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:29 devstack sudo[92929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394 Sep 16 17:41:29 devstack sudo[92929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:30 devstack sudo[92929]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8a811e46-676b-49f4-b32b-2af6d0316266 tempest-VolumesDeleteCascade-396871994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394" returned: 0 in 0.393s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8a811e46-676b-49f4-b32b-2af6d0316266 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.225dab36-40dc-4f76-b947-2b67eb35fd13 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:30 devstack sudo[92935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.225dab36-40dc-4f76-b947-2b67eb35fd13 1G Sep 16 17:41:30 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9311bb60-561b-4693-a2bc-7785723d5446 tempest-VolumesTransfersTest-1662848219 None] Acquiring lock "cinder-a344ddad-7408-44d9-b6d2-972cfbe56265-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9311bb60-561b-4693-a2bc-7785723d5446 tempest-VolumesTransfersTest-1662848219 None] Lock "cinder-a344ddad-7408-44d9-b6d2-972cfbe56265-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9311bb60-561b-4693-a2bc-7785723d5446 tempest-VolumesTransfersTest-1662848219 None] Acquiring lock "cinder-quobyte-a344ddad-7408-44d9-b6d2-972cfbe56265" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9311bb60-561b-4693-a2bc-7785723d5446 tempest-VolumesTransfersTest-1662848219 None] Lock "cinder-quobyte-a344ddad-7408-44d9-b6d2-972cfbe56265" acquired by "delete_volume" :: waited 0.022s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d24430-d6f0-4060-8d98-b107bd602880]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9311bb60-561b-4693-a2bc-7785723d5446 tempest-VolumesTransfersTest-1662848219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a344ddad-7408-44d9-b6d2-972cfbe56265 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:30 devstack sudo[92937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a344ddad-7408-44d9-b6d2-972cfbe56265 Sep 16 17:41:30 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:30 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8a811e46-676b-49f4-b32b-2af6d0316266 tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.225dab36-40dc-4f76-b947-2b67eb35fd13 1G" returned: 0 in 0.520s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8a811e46-676b-49f4-b32b-2af6d0316266 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc309935-f44f-4ab3-9687-8a95c561f394 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.225dab36-40dc-4f76-b947-2b67eb35fd13 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:30 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc309935-f44f-4ab3-9687-8a95c561f394 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.225dab36-40dc-4f76-b947-2b67eb35fd13 Sep 16 17:41:30 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:41:30 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Flow 'volume_create_manager' (ad7501a7-5057-471d-82b1-8af4f860b915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e95353-53e0-469f-9e6c-17f05f7de958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9311bb60-561b-4693-a2bc-7785723d5446 tempest-VolumesTransfersTest-1662848219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a344ddad-7408-44d9-b6d2-972cfbe56265" returned: 0 in 0.547s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9311bb60-561b-4693-a2bc-7785723d5446 tempest-VolumesTransfersTest-1662848219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a344ddad-7408-44d9-b6d2-972cfbe56265 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e95353-53e0-469f-9e6c-17f05f7de958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1954871811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29dbd3a-4095-43d1-acb9-1a8ca8758831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92fb4d493f744fea86dad58ee48948b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:41:31Z,use_quota=True,user_id='6ba252fe8694423f9d3aa72874c3a44f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e81d79-637c-4379-b90b-ad0b5e73b6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:30 devstack sudo[92949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a344ddad-7408-44d9-b6d2-972cfbe56265 Sep 16 17:41:30 devstack sudo[92949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e81d79-637c-4379-b90b-ad0b5e73b6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae3707e-2ad6-46c9-93b2-2ed635d3f2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae3707e-2ad6-46c9-93b2-2ed635d3f2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b29dbd3a-4095-43d1-acb9-1a8ca8758831', 'volume_name': 'volume-b29dbd3a-4095-43d1-acb9-1a8ca8758831', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d258a25-4497-4662-8f5d-e6de72f3078d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d258a25-4497-4662-8f5d-e6de72f3078d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d3105ca-f597-46bd-8bad-963849cfd75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:30 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Volume b29dbd3a-4095-43d1-acb9-1a8ca8758831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b29dbd3a-4095-43d1-acb9-1a8ca8758831', 'volume_size': 1} Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:30 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8a811e46-676b-49f4-b32b-2af6d0316266 tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc309935-f44f-4ab3-9687-8a95c561f394 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.225dab36-40dc-4f76-b947-2b67eb35fd13" returned: 0 in 0.368s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:30 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-8a811e46-676b-49f4-b32b-2af6d0316266 tempest-VolumesDeleteCascade-396871994 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.225dab36-40dc-4f76-b947-2b67eb35fd13 is being set with open permissions: ugo+rw Sep 16 17:41:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8a811e46-676b-49f4-b32b-2af6d0316266 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.225dab36-40dc-4f76-b947-2b67eb35fd13 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:30 devstack sudo[92954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.225dab36-40dc-4f76-b947-2b67eb35fd13 Sep 16 17:41:30 devstack sudo[92954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:31 devstack sudo[92949]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9311bb60-561b-4693-a2bc-7785723d5446 tempest-VolumesTransfersTest-1662848219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a344ddad-7408-44d9-b6d2-972cfbe56265" returned: 0 in 0.272s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9311bb60-561b-4693-a2bc-7785723d5446 tempest-VolumesTransfersTest-1662848219 None] Lock "cinder-quobyte-a344ddad-7408-44d9-b6d2-972cfbe56265" released by "delete_volume" :: held 0.873s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-9311bb60-561b-4693-a2bc-7785723d5446 tempest-VolumesTransfersTest-1662848219 None] Created reservations ['e301d013-309c-4f79-ab72-dc5f6446615e', '7ac9639e-a727-4c39-b8d5-ba643b06e2a3', 'c438b100-2871-4781-92bf-4359d68c3886', 'be96292d-da6e-4c75-b6cd-3d89147422fa'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:41:31 devstack sudo[92954]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8a811e46-676b-49f4-b32b-2af6d0316266 tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.225dab36-40dc-4f76-b947-2b67eb35fd13" returned: 0 in 0.293s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8a811e46-676b-49f4-b32b-2af6d0316266 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9311bb60-561b-4693-a2bc-7785723d5446 tempest-VolumesTransfersTest-1662848219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9311bb60-561b-4693-a2bc-7785723d5446 tempest-VolumesTransfersTest-1662848219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9311bb60-561b-4693-a2bc-7785723d5446 tempest-VolumesTransfersTest-1662848219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:41:31 devstack sudo[92958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.info Sep 16 17:41:31 devstack sudo[92958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9311bb60-561b-4693-a2bc-7785723d5446 tempest-VolumesTransfersTest-1662848219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9311bb60-561b-4693-a2bc-7785723d5446 tempest-VolumesTransfersTest-1662848219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9311bb60-561b-4693-a2bc-7785723d5446 tempest-VolumesTransfersTest-1662848219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:31 devstack sudo[92960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:41:31 devstack sudo[92960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:31 devstack sudo[92958]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:31 devstack sudo[92960]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8a811e46-676b-49f4-b32b-2af6d0316266 tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.info" returned: 0 in 0.301s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:31 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-8a811e46-676b-49f4-b32b-2af6d0316266 tempest-VolumesDeleteCascade-396871994 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.info is being set with open permissions: ugo+rw Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8a811e46-676b-49f4-b32b-2af6d0316266 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9311bb60-561b-4693-a2bc-7785723d5446 tempest-VolumesTransfersTest-1662848219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.276s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-9311bb60-561b-4693-a2bc-7785723d5446 tempest-VolumesTransfersTest-1662848219 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:41:31 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-9311bb60-561b-4693-a2bc-7785723d5446 tempest-VolumesTransfersTest-1662848219 None] Deleted volume successfully. Sep 16 17:41:31 devstack sudo[92964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.info Sep 16 17:41:31 devstack sudo[92964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9311bb60-561b-4693-a2bc-7785723d5446 tempest-VolumesTransfersTest-1662848219 None] Lock "cinder-a344ddad-7408-44d9-b6d2-972cfbe56265-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:41:31 devstack sudo[92964]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8a811e46-676b-49f4-b32b-2af6d0316266 tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.info" returned: 0 in 0.350s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8a811e46-676b-49f4-b32b-2af6d0316266 tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.366s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.049s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1954871811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29dbd3a-4095-43d1-acb9-1a8ca8758831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92fb4d493f744fea86dad58ee48948b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:41:31Z,use_quota=True,user_id='6ba252fe8694423f9d3aa72874c3a44f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Creating volume b29dbd3a-4095-43d1-acb9-1a8ca8758831 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:41:31 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:41:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b29dbd3a-4095-43d1-acb9-1a8ca8758831 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:31 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b29dbd3a-4095-43d1-acb9-1a8ca8758831 1073741824 Sep 16 17:41:31 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Flow 'volume_create_manager' (c748ea90-7952-421a-a7fb-aa7ca34d568c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (569744bf-e9e5-4846-ab0f-f30aee0b76cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:32 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-8a811e46-676b-49f4-b32b-2af6d0316266 tempest-VolumesDeleteCascade-396871994 None] Create snapshot completed successfully Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (569744bf-e9e5-4846-ab0f-f30aee0b76cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-686785382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06fffe5a-774c-4d6c-bc09-019a9d357044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c68597f4dd7f44b4a8b724db00687a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:41:32Z,use_quota=True,user_id='360f1167900f4b189c1551aa9b25bd3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c4edc6-b02c-4178-808a-997dc6ed1423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c4edc6-b02c-4178-808a-997dc6ed1423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d102dde5-5911-427d-9940-70d4a81b7d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d102dde5-5911-427d-9940-70d4a81b7d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06fffe5a-774c-4d6c-bc09-019a9d357044', 'volume_name': 'volume-06fffe5a-774c-4d6c-bc09-019a9d357044', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa804289-2749-4d39-87b7-40f265ec93f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa804289-2749-4d39-87b7-40f265ec93f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a87629b-aa27-4c36-bbe9-20e15563ce14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:32 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Volume 06fffe5a-774c-4d6c-bc09-019a9d357044: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06fffe5a-774c-4d6c-bc09-019a9d357044', 'volume_size': 1} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:32 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b29dbd3a-4095-43d1-acb9-1a8ca8758831 1073741824" returned: 0 in 0.435s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=94,cinder:UPDATE=99,cinder:INSERT=26,cinder:DELETE=8 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b29dbd3a-4095-43d1-acb9-1a8ca8758831 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:32 devstack sudo[92972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b29dbd3a-4095-43d1-acb9-1a8ca8758831 Sep 16 17:41:32 devstack sudo[92972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:32 devstack sudo[92972]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b29dbd3a-4095-43d1-acb9-1a8ca8758831" returned: 0 in 0.240s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.572s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-686785382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06fffe5a-774c-4d6c-bc09-019a9d357044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c68597f4dd7f44b4a8b724db00687a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:41:32Z,use_quota=True,user_id='360f1167900f4b189c1551aa9b25bd3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Creating volume 06fffe5a-774c-4d6c-bc09-019a9d357044 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:41:32 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-06fffe5a-774c-4d6c-bc09-019a9d357044 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:32 devstack sudo[92975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-06fffe5a-774c-4d6c-bc09-019a9d357044 1073741824 Sep 16 17:41:32 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d3105ca-f597-46bd-8bad-963849cfd75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b29dbd3a-4095-43d1-acb9-1a8ca8758831', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55df93cb-8abe-424b-aed2-98c15d59a719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:32 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Volume volume-b29dbd3a-4095-43d1-acb9-1a8ca8758831 (b29dbd3a-4095-43d1-acb9-1a8ca8758831): created successfully Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55df93cb-8abe-424b-aed2-98c15d59a719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Flow 'volume_create_manager' (ad7501a7-5057-471d-82b1-8af4f860b915) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:41:32 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-422ae732-69b5-46cc-8ca4-bc46e743fe24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Created volume successfully. Sep 16 17:41:33 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-06fffe5a-774c-4d6c-bc09-019a9d357044 1073741824" returned: 0 in 0.668s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-06fffe5a-774c-4d6c-bc09-019a9d357044 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:33 devstack sudo[92986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-06fffe5a-774c-4d6c-bc09-019a9d357044 Sep 16 17:41:33 devstack sudo[92986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Flow 'volume_create_manager' (f79f0786-ee2b-4e9a-9302-f09e93d7d900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b62c72-4e59-4122-85cf-56ade9e560ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b62c72-4e59-4122-85cf-56ade9e560ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-9849899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf40ea43-7664-44e4-8ae6-adc42c888994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d218115e859548bfade3d296d2de7f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=225dab36-40dc-4f76-b947-2b67eb35fd13,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:41:33Z,use_quota=True,user_id='44ec77f991dc43e59d1bf2258ed8668f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f0111f-ae5c-49ac-910f-e3201f986e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f0111f-ae5c-49ac-910f-e3201f986e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ce7f0f-44f1-4860-a2e1-32b3bfe4e8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ce7f0f-44f1-4860-a2e1-32b3bfe4e8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cf40ea43-7664-44e4-8ae6-adc42c888994', 'volume_name': 'volume-cf40ea43-7664-44e4-8ae6-adc42c888994', 'volume_size': 1, 'snapshot_id': '225dab36-40dc-4f76-b947-2b67eb35fd13'}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c50c1f-8043-4f7b-8b2d-581866227cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c50c1f-8043-4f7b-8b2d-581866227cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82318e0-5ab7-47c9-819c-26d584ab821e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:33 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Volume cf40ea43-7664-44e4-8ae6-adc42c888994: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cf40ea43-7664-44e4-8ae6-adc42c888994', 'volume_size': 1, 'snapshot_id': '225dab36-40dc-4f76-b947-2b67eb35fd13'} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:33 devstack sudo[92986]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-06fffe5a-774c-4d6c-bc09-019a9d357044" returned: 0 in 0.331s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.058s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "cinder-quobyte-225dab36-40dc-4f76-b947-2b67eb35fd13-cf40ea43-7664-44e4-8ae6-adc42c888994" by "_create_volume_from_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-quobyte-225dab36-40dc-4f76-b947-2b67eb35fd13-cf40ea43-7664-44e4-8ae6-adc42c888994" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Creating volume cf40ea43-7664-44e4-8ae6-adc42c888994 from snapshot 225dab36-40dc-4f76-b947-2b67eb35fd13 {{(pid=85899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "cinder-quobyte-cf40ea43-7664-44e4-8ae6-adc42c888994" by "_copy_volume_from_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a87629b-aa27-4c36-bbe9-20e15563ce14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06fffe5a-774c-4d6c-bc09-019a9d357044', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19735277-fc21-437c-a0b8-7721601ae8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-quobyte-cf40ea43-7664-44e4-8ae6-adc42c888994" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] snapshot: 225dab36-40dc-4f76-b947-2b67eb35fd13, volume: cf40ea43-7664-44e4-8ae6-adc42c888994, {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 17:41:33 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Volume volume-06fffe5a-774c-4d6c-bc09-019a9d357044 (06fffe5a-774c-4d6c-bc09-019a9d357044): created successfully Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19735277-fc21-437c-a0b8-7721601ae8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Flow 'volume_create_manager' (c748ea90-7952-421a-a7fb-aa7ca34d568c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:33 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-0a2755d3-ab84-4e08-b5ad-c2b9a6045b13 tempest-VolumesTransfersTest-1387963106 None] Created volume successfully. Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a439cd-e19c-45bc-9c24-f8b4e694bad7]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.225dab36-40dc-4f76-b947-2b67eb35fd13 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:33 devstack sudo[92989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.225dab36-40dc-4f76-b947-2b67eb35fd13 Sep 16 17:41:33 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:34 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.225dab36-40dc-4f76-b947-2b67eb35fd13" returned: 0 in 0.510s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc309935-f44f-4ab3-9687-8a95c561f394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:41:34 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7d3767-0818-4a80-8923-79adea384d99]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e48bb3d5-37aa-4ac0-babd-5f88f0c5f4f5 tempest-VolumesTransfersTest-1662848219 None] Acquiring lock "cinder-06fffe5a-774c-4d6c-bc09-019a9d357044-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:41:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e48bb3d5-37aa-4ac0-babd-5f88f0c5f4f5 tempest-VolumesTransfersTest-1662848219 None] Lock "cinder-06fffe5a-774c-4d6c-bc09-019a9d357044-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:41:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e48bb3d5-37aa-4ac0-babd-5f88f0c5f4f5 tempest-VolumesTransfersTest-1662848219 None] Acquiring lock "cinder-quobyte-06fffe5a-774c-4d6c-bc09-019a9d357044" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:41:34 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394 Sep 16 17:41:34 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e48bb3d5-37aa-4ac0-babd-5f88f0c5f4f5 tempest-VolumesTransfersTest-1662848219 None] Lock "cinder-quobyte-06fffe5a-774c-4d6c-bc09-019a9d357044" acquired by "delete_volume" :: waited 0.058s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:41:34 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1e1805-75b2-42c9-9253-004a115f9923]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e48bb3d5-37aa-4ac0-babd-5f88f0c5f4f5 tempest-VolumesTransfersTest-1662848219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-06fffe5a-774c-4d6c-bc09-019a9d357044 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:35 devstack sudo[93006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-06fffe5a-774c-4d6c-bc09-019a9d357044 Sep 16 17:41:35 devstack sudo[93006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:35 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394" returned: 0 in 0.674s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394 {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 17:41:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Creating direct copy from snapshot {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 17:41:35 devstack cinder-volume[85899]: DEBUG cinder.utils [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Path /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-cf40ea43-7664-44e4-8ae6-adc42c888994 not found in is_blk_device check {{(pid=85899) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 17:41:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-cf40ea43-7664-44e4-8ae6-adc42c888994 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:35 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-cf40ea43-7664-44e4-8ae6-adc42c888994 Sep 16 17:41:35 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:35 devstack sudo[93006]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e48bb3d5-37aa-4ac0-babd-5f88f0c5f4f5 tempest-VolumesTransfersTest-1662848219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-06fffe5a-774c-4d6c-bc09-019a9d357044" returned: 0 in 0.706s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e48bb3d5-37aa-4ac0-babd-5f88f0c5f4f5 tempest-VolumesTransfersTest-1662848219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-06fffe5a-774c-4d6c-bc09-019a9d357044 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:35 devstack sudo[93056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-06fffe5a-774c-4d6c-bc09-019a9d357044 Sep 16 17:41:35 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:36 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e48bb3d5-37aa-4ac0-babd-5f88f0c5f4f5 tempest-VolumesTransfersTest-1662848219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-06fffe5a-774c-4d6c-bc09-019a9d357044" returned: 0 in 0.562s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e48bb3d5-37aa-4ac0-babd-5f88f0c5f4f5 tempest-VolumesTransfersTest-1662848219 None] Lock "cinder-quobyte-06fffe5a-774c-4d6c-bc09-019a9d357044" released by "delete_volume" :: held 1.380s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:41:36 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-e48bb3d5-37aa-4ac0-babd-5f88f0c5f4f5 tempest-VolumesTransfersTest-1662848219 None] Created reservations ['ebdd420d-d8a9-4df7-bbd4-71f6bf4260a1', 'c2415f8f-af69-42f2-9178-e7329bcd81f3', 'a6c205f9-34bd-468f-a642-e5e2ae2a400b', '757a242b-a160-40af-a068-169a263910d0'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:41:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e48bb3d5-37aa-4ac0-babd-5f88f0c5f4f5 tempest-VolumesTransfersTest-1662848219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e48bb3d5-37aa-4ac0-babd-5f88f0c5f4f5 tempest-VolumesTransfersTest-1662848219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:36 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e48bb3d5-37aa-4ac0-babd-5f88f0c5f4f5 tempest-VolumesTransfersTest-1662848219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:41:36 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e48bb3d5-37aa-4ac0-babd-5f88f0c5f4f5 tempest-VolumesTransfersTest-1662848219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:41:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e48bb3d5-37aa-4ac0-babd-5f88f0c5f4f5 tempest-VolumesTransfersTest-1662848219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e48bb3d5-37aa-4ac0-babd-5f88f0c5f4f5 tempest-VolumesTransfersTest-1662848219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:36 devstack sudo[93083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:41:36 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:37 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e48bb3d5-37aa-4ac0-babd-5f88f0c5f4f5 tempest-VolumesTransfersTest-1662848219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.637s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:37 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-e48bb3d5-37aa-4ac0-babd-5f88f0c5f4f5 tempest-VolumesTransfersTest-1662848219 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:41:37 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-e48bb3d5-37aa-4ac0-babd-5f88f0c5f4f5 tempest-VolumesTransfersTest-1662848219 None] Deleted volume successfully. Sep 16 17:41:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e48bb3d5-37aa-4ac0-babd-5f88f0c5f4f5 tempest-VolumesTransfersTest-1662848219 None] Lock "cinder-06fffe5a-774c-4d6c-bc09-019a9d357044-delete_volume" released by "delete_volume" :: held 2.694s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:41:44 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-cf40ea43-7664-44e4-8ae6-adc42c888994" returned: 0 in 9.756s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:44 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Image conversion details: src /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394, size 1024.00 MB, duration 9.76 sec, destination /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-cf40ea43-7664-44e4-8ae6-adc42c888994 {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:41:44 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Converted 1024.00 MB image at 104.95 MB/s Sep 16 17:41:44 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-cf40ea43-7664-44e4-8ae6-adc42c888994 is being set with open permissions: ugo+rw Sep 16 17:41:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-cf40ea43-7664-44e4-8ae6-adc42c888994 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:44 devstack sudo[93110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-cf40ea43-7664-44e4-8ae6-adc42c888994 Sep 16 17:41:44 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:45 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-cf40ea43-7664-44e4-8ae6-adc42c888994" returned: 0 in 0.258s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-quobyte-cf40ea43-7664-44e4-8ae6-adc42c888994" released by "_copy_volume_from_snapshot" :: held 11.375s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:41:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-quobyte-225dab36-40dc-4f76-b947-2b67eb35fd13-cf40ea43-7664-44e4-8ae6-adc42c888994" released by "_create_volume_from_snapshot" :: held 11.470s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:41:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.495s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82318e0-5ab7-47c9-819c-26d584ab821e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf40ea43-7664-44e4-8ae6-adc42c888994', 'volume_size': 1, 'snapshot_id': '225dab36-40dc-4f76-b947-2b67eb35fd13'}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c89afc0b-3340-4cfb-9481-e4759cfbf84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:45 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Volume volume-cf40ea43-7664-44e4-8ae6-adc42c888994 (cf40ea43-7664-44e4-8ae6-adc42c888994): created successfully Sep 16 17:41:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c89afc0b-3340-4cfb-9481-e4759cfbf84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Flow 'volume_create_manager' (f79f0786-ee2b-4e9a-9302-f09e93d7d900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:41:45 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-cd2ac042-e822-40b7-91bb-582b0fc33295 tempest-VolumesDeleteCascade-396871994 None] Created volume successfully. Sep 16 17:41:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "cinder-bc309935-f44f-4ab3-9687-8a95c561f394-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:41:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-bc309935-f44f-4ab3-9687-8a95c561f394-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:41:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Performing cascade delete. {{(pid=85899) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 16 17:41:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "cinder-225dab36-40dc-4f76-b947-2b67eb35fd13-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:41:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-225dab36-40dc-4f76-b947-2b67eb35fd13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:41:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "cinder-quobyte-bc309935-f44f-4ab3-9687-8a95c561f394" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:41:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-quobyte-bc309935-f44f-4ab3-9687-8a95c561f394" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:41:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "cinder-quobyte-225dab36-40dc-4f76-b947-2b67eb35fd13" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:41:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-quobyte-225dab36-40dc-4f76-b947-2b67eb35fd13" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:41:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Deleting offline snapshot 225dab36-40dc-4f76-b947-2b67eb35fd13 of volume bc309935-f44f-4ab3-9687-8a95c561f394 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:41:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] snapshot_file for this snap is: volume-bc309935-f44f-4ab3-9687-8a95c561f394.225dab36-40dc-4f76-b947-2b67eb35fd13 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:41:46 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[70224782-8270-4864-9df4-ffd06f261772]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.225dab36-40dc-4f76-b947-2b67eb35fd13 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:46 devstack sudo[93133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.225dab36-40dc-4f76-b947-2b67eb35fd13 Sep 16 17:41:46 devstack sudo[93133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:46 devstack sudo[93133]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.225dab36-40dc-4f76-b947-2b67eb35fd13" returned: 0 in 0.501s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc309935-f44f-4ab3-9687-8a95c561f394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:41:46 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34861a0-12d8-438a-8b9b-68bae19597d9]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:46 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394 Sep 16 17:41:46 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:47 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394" returned: 0 in 0.606s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.225dab36-40dc-4f76-b947-2b67eb35fd13 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:47 devstack sudo[93144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.225dab36-40dc-4f76-b947-2b67eb35fd13 Sep 16 17:41:47 devstack sudo[93144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:47 devstack sudo[93144]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.225dab36-40dc-4f76-b947-2b67eb35fd13" returned: 0 in 0.471s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.225dab36-40dc-4f76-b947-2b67eb35fd13 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:47 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.225dab36-40dc-4f76-b947-2b67eb35fd13 Sep 16 17:41:47 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:48 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394.225dab36-40dc-4f76-b947-2b67eb35fd13" returned: 0 in 0.344s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-quobyte-225dab36-40dc-4f76-b947-2b67eb35fd13" released by "_delete_snapshot" :: held 2.066s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:41:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-quobyte-bc309935-f44f-4ab3-9687-8a95c561f394" released by "delete_snapshot" :: held 2.106s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:41:48 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Created reservations ['6c7de614-3c69-4fe1-b2a0-760048d5b3cc', '07988817-de37-4511-8c85-042c3eb2ccfd', '34cc8846-6805-42e4-a901-0b1e80468c34', 'a46bb0fb-7695-4105-b3be-0e49e6eaf253'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:41:48 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Delete snapshot completed successfully. Sep 16 17:41:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-225dab36-40dc-4f76-b947-2b67eb35fd13-delete_snapshot" released by "delete_snapshot" :: held 2.304s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:41:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Snapshots deleted, issuing volume delete {{(pid=85899) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 16 17:41:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "cinder-quobyte-bc309935-f44f-4ab3-9687-8a95c561f394" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:41:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-quobyte-bc309935-f44f-4ab3-9687-8a95c561f394" acquired by "delete_volume" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:41:48 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bd1bd5-48db-402f-89b9-096e608e40d6]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:48 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394 Sep 16 17:41:48 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-5dc4ff69-a1f8-41d9-a409-17ae7a6eda6b req-a7bfda4f-d76e-4ad8-9731-73285ff5fe85 tempest-AttachVolumeShelveTestJSON-2067139834 None] No connector for attachment 92304cfe-7db9-4709-8ab5-291173ce0b70; skipping storage backend terminate_connection call. {{(pid=85899) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5006}} Sep 16 17:41:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-5dc4ff69-a1f8-41d9-a409-17ae7a6eda6b req-a7bfda4f-d76e-4ad8-9731-73285ff5fe85 tempest-AttachVolumeShelveTestJSON-2067139834 None] Deleting attachment 92304cfe-7db9-4709-8ab5-291173ce0b70. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:41:48 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:41:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Flow 'volume_create_manager' (775c2699-d3c3-4a56-9911-43f07edfc67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:41:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8e9623-c35b-421f-a621-7df6cca91108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8e9623-c35b-421f-a621-7df6cca91108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1323979109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aba67fe-ed39-461c-b003-13b5fbfc88e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6169b1cad434069b6f65ebc3dab5bdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:41:49Z,use_quota=True,user_id='0bb5fa0ec19c4c55ba0bd57b2fc2c9d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac377a7-5f10-4204-a5be-206035cd305b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:49 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac377a7-5f10-4204-a5be-206035cd305b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e72f3f-a7bf-47e3-b981-4c201243fa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e72f3f-a7bf-47e3-b981-4c201243fa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aba67fe-ed39-461c-b003-13b5fbfc88e6', 'volume_name': 'volume-4aba67fe-ed39-461c-b003-13b5fbfc88e6', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6c4e9f-bb30-461d-8d68-5b7defe049c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6c4e9f-bb30-461d-8d68-5b7defe049c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a801336e-e959-4d5d-9db3-9873818bb842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:49 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Volume 4aba67fe-ed39-461c-b003-13b5fbfc88e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aba67fe-ed39-461c-b003-13b5fbfc88e6', 'volume_size': 1} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1323979109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aba67fe-ed39-461c-b003-13b5fbfc88e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6169b1cad434069b6f65ebc3dab5bdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:41:49Z,use_quota=True,user_id='0bb5fa0ec19c4c55ba0bd57b2fc2c9d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Creating volume 4aba67fe-ed39-461c-b003-13b5fbfc88e6 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:41:49 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4aba67fe-ed39-461c-b003-13b5fbfc88e6 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394" returned: 0 in 0.564s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:49 devstack sudo[93161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4aba67fe-ed39-461c-b003-13b5fbfc88e6 1073741824 Sep 16 17:41:49 devstack sudo[93161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:41:49 devstack sudo[93163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394 Sep 16 17:41:49 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Flow 'volume_create_manager' (0a8ec45f-97a3-488e-bae5-9256ad62533d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63bf349-b957-449b-ade3-b96f68982755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63bf349-b957-449b-ade3-b96f68982755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2106067875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b54b0ce6def4882a454be74f7f1555a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:41:49Z,use_quota=True,user_id='2677d84e86e24bd1a050ac3d81e2ef98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77ca65c-749b-4e8c-8aa0-f0b3b3a0389b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77ca65c-749b-4e8c-8aa0-f0b3b3a0389b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2848b282-cf9a-406b-b707-91793ceedbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.image.glance [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Creating Keystone auth plugin from conf {{(pid=85899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 17:41:49 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bc309935-f44f-4ab3-9687-8a95c561f394" returned: 0 in 0.331s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-quobyte-bc309935-f44f-4ab3-9687-8a95c561f394" released by "delete_volume" :: held 0.974s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Created reservations ['9202eec1-4488-4f6c-b95f-37e168462e72', '88ff3d7c-4705-47e8-8439-68ebf997d6f4', 'aab2b3d9-0aff-4be1-8803-00a3ca9cc90e', '9551e812-f4ff-4ecd-9834-b8a6968907fb'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2848b282-cf9a-406b-b707-91793ceedbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6', 'volume_name': 'volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6', 'volume_size': 1, 'image_id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '124a9fc6f0b448c1afab7b2b666efe75', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'created_at': datetime.datetime(2026, 9, 16, 15, 30, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 30, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81ac455d-f592-4ef7-8c27-23e4054a633b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f89497b4-c2f8-4bd0-a12d-594d452ff109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f89497b4-c2f8-4bd0-a12d-594d452ff109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4979ed-89c8-48ff-a82f-ad1682d97714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:49 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Volume 0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6', 'volume_size': 1, 'image_id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '124a9fc6f0b448c1afab7b2b666efe75', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'created_at': datetime.datetime(2026, 9, 16, 15, 30, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 30, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81ac455d-f592-4ef7-8c27-23e4054a633b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Trying to clone 0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 from image 81ac455d-f592-4ef7-8c27-23e4054a633b at location (None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}]). {{(pid=85899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 17:41:49 devstack sudo[93161]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4aba67fe-ed39-461c-b003-13b5fbfc88e6 1073741824" returned: 0 in 0.641s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:49 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:41:49 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4aba67fe-ed39-461c-b003-13b5fbfc88e6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:49 devstack sudo[93173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4aba67fe-ed39-461c-b003-13b5fbfc88e6 Sep 16 17:41:49 devstack sudo[93173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:50 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_egeef0xqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 16 17:41:50 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Image download 20.69 MB at 20.69 MB/s Sep 16 17:41:50 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6cbf39-6822-453a-b3ec-47eac7088ebb]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_egeef0xqdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:50 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.448s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:50 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:41:50 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Deleted volume successfully. Sep 16 17:41:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8502f824-ec33-4bc5-a2bd-77b722424ab8 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-bc309935-f44f-4ab3-9687-8a95c561f394-delete_volume" released by "delete_volume" :: held 4.189s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:41:50 devstack sudo[93173]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4aba67fe-ed39-461c-b003-13b5fbfc88e6" returned: 0 in 0.432s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:50 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:41:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a801336e-e959-4d5d-9db3-9873818bb842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aba67fe-ed39-461c-b003-13b5fbfc88e6', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c54bfc0-13c9-4b36-ae13-9c18c4cd2c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:50 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Volume volume-4aba67fe-ed39-461c-b003-13b5fbfc88e6 (4aba67fe-ed39-461c-b003-13b5fbfc88e6): created successfully Sep 16 17:41:50 devstack sudo[93177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_egeef0xqdevstack@QuobyteHD Sep 16 17:41:50 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c54bfc0-13c9-4b36-ae13-9c18c4cd2c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Flow 'volume_create_manager' (775c2699-d3c3-4a56-9911-43f07edfc67a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:41:50 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-19642820-f7d6-4953-a0c7-55380ea35788 tempest-AttachVolumeNegativeTest-195502489 None] Created volume successfully. Sep 16 17:41:50 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_egeef0xqdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:50 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Temporary image 81ac455d-f592-4ef7-8c27-23e4054a633b is fetched for user 2677d84e86e24bd1a050ac3d81e2ef98. {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 16 17:41:50 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea195e14-314e-43a1-96b9-1f1ba4f48db7]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_egeef0xqdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8d39c057-ff68-4821-b117-483d38e60c18 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "cinder-cf40ea43-7664-44e4-8ae6-adc42c888994-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:41:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8d39c057-ff68-4821-b117-483d38e60c18 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-cf40ea43-7664-44e4-8ae6-adc42c888994-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:41:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8d39c057-ff68-4821-b117-483d38e60c18 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "cinder-quobyte-cf40ea43-7664-44e4-8ae6-adc42c888994" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:41:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8d39c057-ff68-4821-b117-483d38e60c18 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-quobyte-cf40ea43-7664-44e4-8ae6-adc42c888994" acquired by "delete_volume" :: waited 0.025s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:41:50 devstack sudo[93186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_egeef0xqdevstack@QuobyteHD Sep 16 17:41:50 devstack sudo[93186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:50 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d374eaee-7443-4eb1-ad59-15d44375e843]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8d39c057-ff68-4821-b117-483d38e60c18 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-cf40ea43-7664-44e4-8ae6-adc42c888994 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:50 devstack sudo[93188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-cf40ea43-7664-44e4-8ae6-adc42c888994 Sep 16 17:41:50 devstack sudo[93188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:51 devstack sudo[93186]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_egeef0xqdevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2106067875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b54b0ce6def4882a454be74f7f1555a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:41:49Z,use_quota=True,user_id='2677d84e86e24bd1a050ac3d81e2ef98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Creating volume 0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:41:51 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:51 devstack sudo[93194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 1073741824 Sep 16 17:41:51 devstack sudo[93194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:51 devstack sudo[93188]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8d39c057-ff68-4821-b117-483d38e60c18 tempest-VolumesDeleteCascade-396871994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-cf40ea43-7664-44e4-8ae6-adc42c888994" returned: 0 in 0.567s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8d39c057-ff68-4821-b117-483d38e60c18 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-cf40ea43-7664-44e4-8ae6-adc42c888994 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:51 devstack sudo[93204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-cf40ea43-7664-44e4-8ae6-adc42c888994 Sep 16 17:41:51 devstack sudo[93204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:51 devstack sudo[93204]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8d39c057-ff68-4821-b117-483d38e60c18 tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-cf40ea43-7664-44e4-8ae6-adc42c888994" returned: 0 in 0.350s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8d39c057-ff68-4821-b117-483d38e60c18 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-quobyte-cf40ea43-7664-44e4-8ae6-adc42c888994" released by "delete_volume" :: held 0.994s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:41:51 devstack sudo[93194]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 1073741824" returned: 0 in 0.720s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-8d39c057-ff68-4821-b117-483d38e60c18 tempest-VolumesDeleteCascade-396871994 None] Created reservations ['ace3249b-7006-4ea5-9d16-0fb0c21e5c34', 'c15c0f69-578d-48dc-8d3f-98dc47f00438', 'd96bc08d-03fe-45e3-ad02-99905bad5fe0', '04e5e83b-13b2-46c5-8b4a-6671ed29a04f'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:51 devstack sudo[93212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 Sep 16 17:41:51 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8d39c057-ff68-4821-b117-483d38e60c18 tempest-VolumesDeleteCascade-396871994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8d39c057-ff68-4821-b117-483d38e60c18 tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8d39c057-ff68-4821-b117-483d38e60c18 tempest-VolumesDeleteCascade-396871994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8d39c057-ff68-4821-b117-483d38e60c18 tempest-VolumesDeleteCascade-396871994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8d39c057-ff68-4821-b117-483d38e60c18 tempest-VolumesDeleteCascade-396871994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8d39c057-ff68-4821-b117-483d38e60c18 tempest-VolumesDeleteCascade-396871994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:52 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:41:52 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-ae9fa75f-77ca-4a34-8994-c98a2f4b6f3b req-695b97d7-ecc5-4769-8c24-ffcd18150a5f tempest-AttachVolumeNegativeTest-195502489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:52 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6" returned: 0 in 0.352s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:41:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-ae9fa75f-77ca-4a34-8994-c98a2f4b6f3b req-695b97d7-ecc5-4769-8c24-ffcd18150a5f tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.043s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-ae9fa75f-77ca-4a34-8994-c98a2f4b6f3b req-695b97d7-ecc5-4769-8c24-ffcd18150a5f tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:52 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Attempting download of 81ac455d-f592-4ef7-8c27-23e4054a633b ((None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}])) to volume 0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6. {{(pid=85899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 17:41:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-ae9fa75f-77ca-4a34-8994-c98a2f4b6f3b req-695b97d7-ecc5-4769-8c24-ffcd18150a5f tempest-AttachVolumeNegativeTest-195502489 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7', 'name': 'volume-4aba67fe-ed39-461c-b003-13b5fbfc88e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86072e7f-1162-4116-a08e-cc2c0af7886c', 'enforce_multipath': True} {{(pid=85899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4920}} Sep 16 17:41:52 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac12e87a-aefa-4d79-b8c7-4456a75c35da]: (4, 'raw') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_37pi_wud {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:52 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8d39c057-ff68-4821-b117-483d38e60c18 tempest-VolumesDeleteCascade-396871994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.463s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:52 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-8d39c057-ff68-4821-b117-483d38e60c18 tempest-VolumesDeleteCascade-396871994 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:41:52 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-8d39c057-ff68-4821-b117-483d38e60c18 tempest-VolumesDeleteCascade-396871994 None] Deleted volume successfully. Sep 16 17:41:52 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-ae9fa75f-77ca-4a34-8994-c98a2f4b6f3b req-695b97d7-ecc5-4769-8c24-ffcd18150a5f tempest-AttachVolumeNegativeTest-195502489 None] attachment_update completed successfully. Sep 16 17:41:52 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8d39c057-ff68-4821-b117-483d38e60c18 tempest-VolumesDeleteCascade-396871994 None] Lock "cinder-cf40ea43-7664-44e4-8ae6-adc42c888994-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:41:52 devstack sudo[93227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_37pi_wud Sep 16 17:41:52 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:52 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_37pi_wud" returned: 0 in 0.424s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_37pi_wud {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:52 devstack sudo[93458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_37pi_wud Sep 16 17:41:52 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:53 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_37pi_wud" returned: 1 in 0.516s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_37pi_wud' failed. Not Retrying. {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:41:53 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[df598df5-b455-46c0-b945-f5e075c0ee9f]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_egeef0xqdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:53 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_egeef0xqdevstack@QuobyteHD Sep 16 17:41:53 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:53 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_egeef0xqdevstack@QuobyteHD" returned: 0 in 0.562s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:53 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] 81ac455d-f592-4ef7-8c27-23e4054a633b was qcow2, converting to qcow2 {{(pid=85899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 16 17:41:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_egeef0xqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:53 devstack sudo[93654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_egeef0xqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 Sep 16 17:41:53 devstack sudo[93654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:55 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-90efa79d-6b39-4bfb-a53d-85585e7b1f89 req-79d12189-4ebb-43e7-bec2-7907d47b3001 tempest-AttachVolumeNegativeTest-195502489 None] Terminate volume connection completed successfully. Sep 16 17:41:55 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-90efa79d-6b39-4bfb-a53d-85585e7b1f89 req-79d12189-4ebb-43e7-bec2-7907d47b3001 tempest-AttachVolumeNegativeTest-195502489 None] Deleting attachment 86072e7f-1162-4116-a08e-cc2c0af7886c. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:41:56 devstack sudo[93654]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_egeef0xqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6" returned: 0 in 3.092s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:57 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_egeef0xqdevstack@QuobyteHD, size 112.00 MB, duration 3.09 sec, destination /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:41:57 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Converted 112.00 MB image at 36.21 MB/s Sep 16 17:41:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:57 devstack sudo[93713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 1G Sep 16 17:41:57 devstack sudo[93713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:57 devstack sudo[93713]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 1G" returned: 0 in 0.624s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:57 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Downloaded image 81ac455d-f592-4ef7-8c27-23e4054a633b ((None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}])) to volume 0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 successfully. {{(pid=85899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 17:41:57 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Temporary image 81ac455d-f592-4ef7-8c27-23e4054a633b for user 2677d84e86e24bd1a050ac3d81e2ef98 is deleted. {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 16 17:41:57 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Marking volume 0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 as bootable. {{(pid=85899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 17:41:57 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Copying metadata from image 81ac455d-f592-4ef7-8c27-23e4054a633b to 0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6. {{(pid=85899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 17:41:57 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Creating volume glance metadata for volume 0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 backed by image 81ac455d-f592-4ef7-8c27-23e4054a633b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 17:41:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4979ed-89c8-48ff-a82f-ad1682d97714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6', 'volume_size': 1, 'image_id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '124a9fc6f0b448c1afab7b2b666efe75', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'created_at': datetime.datetime(2026, 9, 16, 15, 30, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 30, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81ac455d-f592-4ef7-8c27-23e4054a633b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9977b8-f60c-41d8-9a71-9245e53e97da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:41:57 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Volume volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 (0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6): created successfully Sep 16 17:41:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9977b8-f60c-41d8-9a71-9245e53e97da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:41:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Flow 'volume_create_manager' (0a8ec45f-97a3-488e-bae5-9256ad62533d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:41:57 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-e0e298f7-cd26-4d22-9fda-a4f5bc535cc1 tempest-VolumesExtendTest-1053195174 None] Created volume successfully. Sep 16 17:41:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5ce0d946-a146-42d5-a2ba-946b88a12b75 tempest-VolumesExtendTest-1053195174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:41:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5ce0d946-a146-42d5-a2ba-946b88a12b75 tempest-VolumesExtendTest-1053195174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:41:58 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac61dbb-4924-4b19-8b20-8a6a95ef763c]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:41:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5ce0d946-a146-42d5-a2ba-946b88a12b75 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:58 devstack sudo[93755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 Sep 16 17:41:58 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:41:59 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root Sep 16 17:41:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5ce0d946-a146-42d5-a2ba-946b88a12b75 tempest-VolumesExtendTest-1053195174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6" returned: 0 in 0.516s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5ce0d946-a146-42d5-a2ba-946b88a12b75 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 2G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:41:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5ce0d946-a146-42d5-a2ba-946b88a12b75 tempest-VolumesExtendTest-1053195174 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 2G" returned: 0 in 0.187s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:41:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5ce0d946-a146-42d5-a2ba-946b88a12b75 tempest-VolumesExtendTest-1053195174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.755s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:41:59 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5ce0d946-a146-42d5-a2ba-946b88a12b75 tempest-VolumesExtendTest-1053195174 None] Extend volume completed successfully. Sep 16 17:42:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0785f5f2-89d2-4a10-86b9-2725e9c99731 tempest-VolumesExtendTest-1053195174 None] Acquiring lock "cinder-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0785f5f2-89d2-4a10-86b9-2725e9c99731 tempest-VolumesExtendTest-1053195174 None] Lock "cinder-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0785f5f2-89d2-4a10-86b9-2725e9c99731 tempest-VolumesExtendTest-1053195174 None] Acquiring lock "cinder-quobyte-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0785f5f2-89d2-4a10-86b9-2725e9c99731 tempest-VolumesExtendTest-1053195174 None] Lock "cinder-quobyte-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6" acquired by "delete_volume" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:00 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47c9a24-47c3-4031-a6d1-f933fe9aaafc]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0785f5f2-89d2-4a10-86b9-2725e9c99731 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:00 devstack sudo[93764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 Sep 16 17:42:00 devstack sudo[93764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:01 devstack sudo[93764]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0785f5f2-89d2-4a10-86b9-2725e9c99731 tempest-VolumesExtendTest-1053195174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6" returned: 0 in 0.750s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0785f5f2-89d2-4a10-86b9-2725e9c99731 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:01 devstack sudo[93826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6 Sep 16 17:42:01 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:01 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0785f5f2-89d2-4a10-86b9-2725e9c99731 tempest-VolumesExtendTest-1053195174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6" returned: 0 in 0.497s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0785f5f2-89d2-4a10-86b9-2725e9c99731 tempest-VolumesExtendTest-1053195174 None] Lock "cinder-quobyte-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6" released by "delete_volume" :: held 1.328s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:01 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-0785f5f2-89d2-4a10-86b9-2725e9c99731 tempest-VolumesExtendTest-1053195174 None] Created reservations ['da1f8c2f-9eab-46d2-9f9e-25a0595050a4', '624eddc4-4de2-4871-a3d2-375ddd042494', 'ff024fb1-01b4-40e4-a747-06d276c264a2', '36e29392-9668-421e-aee2-4d0d27828af8'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:42:01 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:42:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Flow 'volume_create_manager' (98482518-c5a6-4a65-b733-e3a35fb88971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:42:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fce76e7-31c9-4d5e-9a34-bd058706aa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fce76e7-31c9-4d5e-9a34-bd058706aa14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-919442278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de26b8b7-70ec-498c-88eb-e79495ec8a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c95f173d774ce09a11fc18eb812164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:42:02Z,use_quota=True,user_id='852a5c27f8904f61a366926e477775bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf06fef-8a65-4222-a59b-e4991d34455e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf06fef-8a65-4222-a59b-e4991d34455e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e94bdad-f432-47a1-9a8e-f987e2693026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e94bdad-f432-47a1-9a8e-f987e2693026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de26b8b7-70ec-498c-88eb-e79495ec8a55', 'volume_name': 'volume-de26b8b7-70ec-498c-88eb-e79495ec8a55', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bae43c4-b79a-4c92-bc8d-acb379412bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bae43c4-b79a-4c92-bc8d-acb379412bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255c09a8-5707-410f-b86a-76d2d3d533d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:02 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Volume de26b8b7-70ec-498c-88eb-e79495ec8a55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de26b8b7-70ec-498c-88eb-e79495ec8a55', 'volume_size': 1} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-919442278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de26b8b7-70ec-498c-88eb-e79495ec8a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c95f173d774ce09a11fc18eb812164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:42:02Z,use_quota=True,user_id='852a5c27f8904f61a366926e477775bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Creating volume de26b8b7-70ec-498c-88eb-e79495ec8a55 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:42:02 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de26b8b7-70ec-498c-88eb-e79495ec8a55 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0785f5f2-89d2-4a10-86b9-2725e9c99731 tempest-VolumesExtendTest-1053195174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0785f5f2-89d2-4a10-86b9-2725e9c99731 tempest-VolumesExtendTest-1053195174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0785f5f2-89d2-4a10-86b9-2725e9c99731 tempest-VolumesExtendTest-1053195174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0785f5f2-89d2-4a10-86b9-2725e9c99731 tempest-VolumesExtendTest-1053195174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0785f5f2-89d2-4a10-86b9-2725e9c99731 tempest-VolumesExtendTest-1053195174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0785f5f2-89d2-4a10-86b9-2725e9c99731 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:02 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de26b8b7-70ec-498c-88eb-e79495ec8a55 1073741824 Sep 16 17:42:02 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:02 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:42:02 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:02 devstack sudo[93843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:42:02 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:02 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0785f5f2-89d2-4a10-86b9-2725e9c99731 tempest-VolumesExtendTest-1053195174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.510s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-0785f5f2-89d2-4a10-86b9-2725e9c99731 tempest-VolumesExtendTest-1053195174 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:42:02 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-0785f5f2-89d2-4a10-86b9-2725e9c99731 tempest-VolumesExtendTest-1053195174 None] Deleted volume successfully. Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0785f5f2-89d2-4a10-86b9-2725e9c99731 tempest-VolumesExtendTest-1053195174 None] Lock "cinder-0bebdd27-d0fd-421b-a6c5-7c2f38eec6a6-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:02 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.583s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager._thread_info {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread count: 28 {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread info: [<_MainThread(MainThread, started 123748124422272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:42:02 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de26b8b7-70ec-498c-88eb-e79495ec8a55 1073741824" returned: 0 in 0.865s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de26b8b7-70ec-498c-88eb-e79495ec8a55 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:03 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de26b8b7-70ec-498c-88eb-e79495ec8a55 Sep 16 17:42:03 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3520663d-118e-4444-8613-106d30f2ba57 tempest-AttachVolumeNegativeTest-195502489 None] Acquiring lock "cinder-4aba67fe-ed39-461c-b003-13b5fbfc88e6-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3520663d-118e-4444-8613-106d30f2ba57 tempest-AttachVolumeNegativeTest-195502489 None] Lock "cinder-4aba67fe-ed39-461c-b003-13b5fbfc88e6-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3520663d-118e-4444-8613-106d30f2ba57 tempest-AttachVolumeNegativeTest-195502489 None] Acquiring lock "cinder-quobyte-4aba67fe-ed39-461c-b003-13b5fbfc88e6" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3520663d-118e-4444-8613-106d30f2ba57 tempest-AttachVolumeNegativeTest-195502489 None] Lock "cinder-quobyte-4aba67fe-ed39-461c-b003-13b5fbfc88e6" acquired by "delete_volume" :: waited 0.026s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:03 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de26b8b7-70ec-498c-88eb-e79495ec8a55" returned: 0 in 0.591s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255c09a8-5707-410f-b86a-76d2d3d533d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de26b8b7-70ec-498c-88eb-e79495ec8a55', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6948cee-7a9e-411c-867f-2c4a1a41e703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b070622-56b7-4ee3-8b33-859878a391f9]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3520663d-118e-4444-8613-106d30f2ba57 tempest-AttachVolumeNegativeTest-195502489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4aba67fe-ed39-461c-b003-13b5fbfc88e6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:03 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Volume volume-de26b8b7-70ec-498c-88eb-e79495ec8a55 (de26b8b7-70ec-498c-88eb-e79495ec8a55): created successfully Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6948cee-7a9e-411c-867f-2c4a1a41e703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Flow 'volume_create_manager' (98482518-c5a6-4a65-b733-e3a35fb88971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:42:03 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-ba288d6c-f75f-490e-ba6c-31b3390bcbe9 tempest-VolumesTransfersV357Test-629307909 None] Created volume successfully. Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Flow 'volume_create_manager' (02f85078-dd44-4beb-82d5-beec2b4f2b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35fbb6b4-2e44-439a-a431-a1d3c5773291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35fbb6b4-2e44-439a-a431-a1d3c5773291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-389385796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c8da6c-fb91-4f72-a312-b1d7ec906386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b54b0ce6def4882a454be74f7f1555a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:42:04Z,use_quota=True,user_id='2677d84e86e24bd1a050ac3d81e2ef98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:03 devstack sudo[93860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4aba67fe-ed39-461c-b003-13b5fbfc88e6 Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b088554-5e9f-47a4-96f7-412e82a1bc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:03 devstack sudo[93860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b088554-5e9f-47a4-96f7-412e82a1bc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b5b5aa-27f8-4a98-a275-75116d60f3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b5b5aa-27f8-4a98-a275-75116d60f3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1c8da6c-fb91-4f72-a312-b1d7ec906386', 'volume_name': 'volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95957fae-4a20-4e1e-91e8-30cc4221b6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95957fae-4a20-4e1e-91e8-30cc4221b6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090ef3d7-ee01-474c-a085-9f8681f02852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:03 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Volume d1c8da6c-fb91-4f72-a312-b1d7ec906386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386', 'volume_size': 1} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-389385796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c8da6c-fb91-4f72-a312-b1d7ec906386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b54b0ce6def4882a454be74f7f1555a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:42:04Z,use_quota=True,user_id='2677d84e86e24bd1a050ac3d81e2ef98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Creating volume d1c8da6c-fb91-4f72-a312-b1d7ec906386 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:42:03 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:42:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:03 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386 1073741824 Sep 16 17:42:03 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:04 devstack sudo[93860]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3520663d-118e-4444-8613-106d30f2ba57 tempest-AttachVolumeNegativeTest-195502489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4aba67fe-ed39-461c-b003-13b5fbfc88e6" returned: 0 in 0.586s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3520663d-118e-4444-8613-106d30f2ba57 tempest-AttachVolumeNegativeTest-195502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4aba67fe-ed39-461c-b003-13b5fbfc88e6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:04 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4aba67fe-ed39-461c-b003-13b5fbfc88e6 Sep 16 17:42:04 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:04 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3520663d-118e-4444-8613-106d30f2ba57 tempest-AttachVolumeNegativeTest-195502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4aba67fe-ed39-461c-b003-13b5fbfc88e6" returned: 0 in 0.392s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:04 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386 1073741824" returned: 0 in 0.754s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:04 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3520663d-118e-4444-8613-106d30f2ba57 tempest-AttachVolumeNegativeTest-195502489 None] Lock "cinder-quobyte-4aba67fe-ed39-461c-b003-13b5fbfc88e6" released by "delete_volume" :: held 1.079s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:04 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-3520663d-118e-4444-8613-106d30f2ba57 tempest-AttachVolumeNegativeTest-195502489 None] Created reservations ['f908a058-f864-4aac-9da0-d6902f7858e7', '5410902f-5a1a-4415-a08b-058debcd3d25', '73835eaa-d4c1-4ce2-af75-89d5d81fb94b', '80d568ba-204d-4684-89db-9f8e0b7d9b53'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:42:04 devstack sudo[93875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386 Sep 16 17:42:04 devstack sudo[93875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3520663d-118e-4444-8613-106d30f2ba57 tempest-AttachVolumeNegativeTest-195502489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3520663d-118e-4444-8613-106d30f2ba57 tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:04 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3520663d-118e-4444-8613-106d30f2ba57 tempest-AttachVolumeNegativeTest-195502489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:42:04 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3520663d-118e-4444-8613-106d30f2ba57 tempest-AttachVolumeNegativeTest-195502489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:42:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3520663d-118e-4444-8613-106d30f2ba57 tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3520663d-118e-4444-8613-106d30f2ba57 tempest-AttachVolumeNegativeTest-195502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:04 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:42:04 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:04 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-9e89df8e-5472-45e4-afdc-aab778df56a9 tempest-VolumesTransfersV357Test-2030184272 None] Transfer volume completed successfully. Sep 16 17:42:05 devstack sudo[93875]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386" returned: 0 in 0.328s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:05 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:42:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:05 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090ef3d7-ee01-474c-a085-9f8681f02852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:05 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c2156f-a980-4220-9e2e-490c6441a56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:05 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Volume volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386 (d1c8da6c-fb91-4f72-a312-b1d7ec906386): created successfully Sep 16 17:42:05 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c2156f-a980-4220-9e2e-490c6441a56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:05 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Flow 'volume_create_manager' (02f85078-dd44-4beb-82d5-beec2b4f2b36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:42:05 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-c8425079-c6d5-42b7-a429-c61b1204301b tempest-VolumesExtendTest-1053195174 None] Created volume successfully. Sep 16 17:42:05 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3520663d-118e-4444-8613-106d30f2ba57 tempest-AttachVolumeNegativeTest-195502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.351s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:05 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-3520663d-118e-4444-8613-106d30f2ba57 tempest-AttachVolumeNegativeTest-195502489 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:42:05 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-3520663d-118e-4444-8613-106d30f2ba57 tempest-AttachVolumeNegativeTest-195502489 None] Deleted volume successfully. Sep 16 17:42:05 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3520663d-118e-4444-8613-106d30f2ba57 tempest-AttachVolumeNegativeTest-195502489 None] Lock "cinder-4aba67fe-ed39-461c-b003-13b5fbfc88e6-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:05 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-26850846-28b7-40bf-81bb-108c2795e966 tempest-VolumesTransfersV357Test-448147750 None] Acquiring lock "cinder-de26b8b7-70ec-498c-88eb-e79495ec8a55-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:05 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-26850846-28b7-40bf-81bb-108c2795e966 tempest-VolumesTransfersV357Test-448147750 None] Lock "cinder-de26b8b7-70ec-498c-88eb-e79495ec8a55-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:05 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-26850846-28b7-40bf-81bb-108c2795e966 tempest-VolumesTransfersV357Test-448147750 None] Acquiring lock "cinder-quobyte-de26b8b7-70ec-498c-88eb-e79495ec8a55" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:05 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-26850846-28b7-40bf-81bb-108c2795e966 tempest-VolumesTransfersV357Test-448147750 None] Lock "cinder-quobyte-de26b8b7-70ec-498c-88eb-e79495ec8a55" acquired by "delete_volume" :: waited 0.030s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:05 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[52922017-f747-4528-b371-d117299c5fc2]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-26850846-28b7-40bf-81bb-108c2795e966 tempest-VolumesTransfersV357Test-448147750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de26b8b7-70ec-498c-88eb-e79495ec8a55 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:05 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de26b8b7-70ec-498c-88eb-e79495ec8a55 Sep 16 17:42:05 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:05 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f32a301e-461d-4f5d-8f8c-e451a9f63bb0 tempest-AttachVolumeNegativeTest-195502489 None] Acquiring lock "cinder-5888613e-dd40-4381-aba8-8a730d386527-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e738e394-da64-486d-bf55-fb80e65a4442 tempest-VolumesExtendTest-1053195174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e738e394-da64-486d-bf55-fb80e65a4442 tempest-VolumesExtendTest-1053195174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:05 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f32a301e-461d-4f5d-8f8c-e451a9f63bb0 tempest-AttachVolumeNegativeTest-195502489 None] Lock "cinder-5888613e-dd40-4381-aba8-8a730d386527-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:05 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-e738e394-da64-486d-bf55-fb80e65a4442 tempest-VolumesExtendTest-1053195174 None] Creating offline snapshot b8ca2698-011d-43f0-aadc-2f2d038ee263 of volume d1c8da6c-fb91-4f72-a312-b1d7ec906386 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:42:05 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e277c6f2-2fc8-45fe-a0d3-229a64c8daf0]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e738e394-da64-486d-bf55-fb80e65a4442 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:06 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f32a301e-461d-4f5d-8f8c-e451a9f63bb0 tempest-AttachVolumeNegativeTest-195502489 None] Acquiring lock "cinder-quobyte-5888613e-dd40-4381-aba8-8a730d386527" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:06 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f32a301e-461d-4f5d-8f8c-e451a9f63bb0 tempest-AttachVolumeNegativeTest-195502489 None] Lock "cinder-quobyte-5888613e-dd40-4381-aba8-8a730d386527" acquired by "delete_volume" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:06 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa67d4b-d5b1-4fdd-a6aa-dfab0c98c6ac]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f32a301e-461d-4f5d-8f8c-e451a9f63bb0 tempest-AttachVolumeNegativeTest-195502489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5888613e-dd40-4381-aba8-8a730d386527 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:06 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386 Sep 16 17:42:06 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:06 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-26850846-28b7-40bf-81bb-108c2795e966 tempest-VolumesTransfersV357Test-448147750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de26b8b7-70ec-498c-88eb-e79495ec8a55" returned: 0 in 0.418s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-26850846-28b7-40bf-81bb-108c2795e966 tempest-VolumesTransfersV357Test-448147750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de26b8b7-70ec-498c-88eb-e79495ec8a55 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:06 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de26b8b7-70ec-498c-88eb-e79495ec8a55 Sep 16 17:42:06 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:06 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5888613e-dd40-4381-aba8-8a730d386527 Sep 16 17:42:06 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:06 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:06 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e738e394-da64-486d-bf55-fb80e65a4442 tempest-VolumesExtendTest-1053195174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386" returned: 0 in 0.421s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-26850846-28b7-40bf-81bb-108c2795e966 tempest-VolumesTransfersV357Test-448147750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de26b8b7-70ec-498c-88eb-e79495ec8a55" returned: 0 in 0.258s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e738e394-da64-486d-bf55-fb80e65a4442 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.b8ca2698-011d-43f0-aadc-2f2d038ee263 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:06 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.b8ca2698-011d-43f0-aadc-2f2d038ee263 1G Sep 16 17:42:06 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:06 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-26850846-28b7-40bf-81bb-108c2795e966 tempest-VolumesTransfersV357Test-448147750 None] Lock "cinder-quobyte-de26b8b7-70ec-498c-88eb-e79495ec8a55" released by "delete_volume" :: held 0.779s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:06 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f32a301e-461d-4f5d-8f8c-e451a9f63bb0 tempest-AttachVolumeNegativeTest-195502489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5888613e-dd40-4381-aba8-8a730d386527" returned: 0 in 0.466s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f32a301e-461d-4f5d-8f8c-e451a9f63bb0 tempest-AttachVolumeNegativeTest-195502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5888613e-dd40-4381-aba8-8a730d386527 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:06 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-26850846-28b7-40bf-81bb-108c2795e966 tempest-VolumesTransfersV357Test-448147750 None] Created reservations ['9cb53bf2-f62e-4d7a-8b08-2795933f9011', 'dde992e9-f876-456c-ba61-003169344f1a', '94c7d28a-2008-41f0-a42e-d17e01d7a134', 'c7b10e49-7504-4a9d-a7a1-e69450437ef5'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:42:06 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5888613e-dd40-4381-aba8-8a730d386527 Sep 16 17:42:06 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-26850846-28b7-40bf-81bb-108c2795e966 tempest-VolumesTransfersV357Test-448147750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-26850846-28b7-40bf-81bb-108c2795e966 tempest-VolumesTransfersV357Test-448147750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:06 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-26850846-28b7-40bf-81bb-108c2795e966 tempest-VolumesTransfersV357Test-448147750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:42:06 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-26850846-28b7-40bf-81bb-108c2795e966 tempest-VolumesTransfersV357Test-448147750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:42:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-26850846-28b7-40bf-81bb-108c2795e966 tempest-VolumesTransfersV357Test-448147750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-26850846-28b7-40bf-81bb-108c2795e966 tempest-VolumesTransfersV357Test-448147750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:06 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:42:06 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:06 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f32a301e-461d-4f5d-8f8c-e451a9f63bb0 tempest-AttachVolumeNegativeTest-195502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5888613e-dd40-4381-aba8-8a730d386527" returned: 0 in 0.345s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:06 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f32a301e-461d-4f5d-8f8c-e451a9f63bb0 tempest-AttachVolumeNegativeTest-195502489 None] Lock "cinder-quobyte-5888613e-dd40-4381-aba8-8a730d386527" released by "delete_volume" :: held 0.874s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-f32a301e-461d-4f5d-8f8c-e451a9f63bb0 tempest-AttachVolumeNegativeTest-195502489 None] Created reservations ['ba379b89-9542-400c-9397-54fb7c183625', '28d303b9-b5cf-4959-be7c-fdae4550b877', 'fb121191-3e88-47c1-896d-75cfb33df7df', 'e8635a7e-1adb-4d36-bb95-c37e5528a116'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:42:07 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e738e394-da64-486d-bf55-fb80e65a4442 tempest-VolumesExtendTest-1053195174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.b8ca2698-011d-43f0-aadc-2f2d038ee263 1G" returned: 0 in 0.617s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e738e394-da64-486d-bf55-fb80e65a4442 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.b8ca2698-011d-43f0-aadc-2f2d038ee263 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:07 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-26850846-28b7-40bf-81bb-108c2795e966 tempest-VolumesTransfersV357Test-448147750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.393s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-26850846-28b7-40bf-81bb-108c2795e966 tempest-VolumesTransfersV357Test-448147750 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:42:07 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.b8ca2698-011d-43f0-aadc-2f2d038ee263 Sep 16 17:42:07 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:07 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-26850846-28b7-40bf-81bb-108c2795e966 tempest-VolumesTransfersV357Test-448147750 None] Deleted volume successfully. Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-26850846-28b7-40bf-81bb-108c2795e966 tempest-VolumesTransfersV357Test-448147750 None] Lock "cinder-de26b8b7-70ec-498c-88eb-e79495ec8a55-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f32a301e-461d-4f5d-8f8c-e451a9f63bb0 tempest-AttachVolumeNegativeTest-195502489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f32a301e-461d-4f5d-8f8c-e451a9f63bb0 tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f32a301e-461d-4f5d-8f8c-e451a9f63bb0 tempest-AttachVolumeNegativeTest-195502489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f32a301e-461d-4f5d-8f8c-e451a9f63bb0 tempest-AttachVolumeNegativeTest-195502489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f32a301e-461d-4f5d-8f8c-e451a9f63bb0 tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f32a301e-461d-4f5d-8f8c-e451a9f63bb0 tempest-AttachVolumeNegativeTest-195502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:07 devstack sudo[93915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:42:07 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:07 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e738e394-da64-486d-bf55-fb80e65a4442 tempest-VolumesExtendTest-1053195174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.b8ca2698-011d-43f0-aadc-2f2d038ee263" returned: 0 in 0.425s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:07 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-e738e394-da64-486d-bf55-fb80e65a4442 tempest-VolumesExtendTest-1053195174 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.b8ca2698-011d-43f0-aadc-2f2d038ee263 is being set with open permissions: ugo+rw Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e738e394-da64-486d-bf55-fb80e65a4442 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.b8ca2698-011d-43f0-aadc-2f2d038ee263 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:07 devstack sudo[93921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.b8ca2698-011d-43f0-aadc-2f2d038ee263 Sep 16 17:42:07 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:07 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f32a301e-461d-4f5d-8f8c-e451a9f63bb0 tempest-AttachVolumeNegativeTest-195502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.387s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-f32a301e-461d-4f5d-8f8c-e451a9f63bb0 tempest-AttachVolumeNegativeTest-195502489 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:42:07 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-f32a301e-461d-4f5d-8f8c-e451a9f63bb0 tempest-AttachVolumeNegativeTest-195502489 None] Deleted volume successfully. Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f32a301e-461d-4f5d-8f8c-e451a9f63bb0 tempest-AttachVolumeNegativeTest-195502489 None] Lock "cinder-5888613e-dd40-4381-aba8-8a730d386527-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Flow 'volume_create_manager' (08cf961e-fe19-4c05-9da5-46bd5d0eb4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (806068c6-bf6c-42fa-81e9-168b940c0b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (806068c6-bf6c-42fa-81e9-168b940c0b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1031444147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a53d5ca-e7e8-49c8-a113-4e3f5ab05886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c95f173d774ce09a11fc18eb812164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:42:08Z,use_quota=True,user_id='852a5c27f8904f61a366926e477775bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dbdeab2-7032-4d4a-bea0-211b182b5aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dbdeab2-7032-4d4a-bea0-211b182b5aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:07 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d603cc-60be-4f25-a468-650d31eb5d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d603cc-60be-4f25-a468-650d31eb5d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a53d5ca-e7e8-49c8-a113-4e3f5ab05886', 'volume_name': 'volume-7a53d5ca-e7e8-49c8-a113-4e3f5ab05886', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (396f0a3e-6613-4941-aeea-2ca2be69c08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (396f0a3e-6613-4941-aeea-2ca2be69c08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19de70fc-b265-4a0b-b552-34e9cd2a3ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:07 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Volume 7a53d5ca-e7e8-49c8-a113-4e3f5ab05886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a53d5ca-e7e8-49c8-a113-4e3f5ab05886', 'volume_size': 1} Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e738e394-da64-486d-bf55-fb80e65a4442 tempest-VolumesExtendTest-1053195174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.b8ca2698-011d-43f0-aadc-2f2d038ee263" returned: 0 in 0.310s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e738e394-da64-486d-bf55-fb80e65a4442 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:07 devstack sudo[93925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.info Sep 16 17:42:07 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:08 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e738e394-da64-486d-bf55-fb80e65a4442 tempest-VolumesExtendTest-1053195174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.info" returned: 0 in 0.267s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:08 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-e738e394-da64-486d-bf55-fb80e65a4442 tempest-VolumesExtendTest-1053195174 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.info is being set with open permissions: ugo+rw Sep 16 17:42:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e738e394-da64-486d-bf55-fb80e65a4442 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:08 devstack sudo[93928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.info Sep 16 17:42:08 devstack sudo[93928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:08 devstack sudo[93928]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e738e394-da64-486d-bf55-fb80e65a4442 tempest-VolumesExtendTest-1053195174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.info" returned: 0 in 0.259s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e738e394-da64-486d-bf55-fb80e65a4442 tempest-VolumesExtendTest-1053195174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.436s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.585s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:08 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1031444147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a53d5ca-e7e8-49c8-a113-4e3f5ab05886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c95f173d774ce09a11fc18eb812164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:42:08Z,use_quota=True,user_id='852a5c27f8904f61a366926e477775bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:42:08 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Creating volume 7a53d5ca-e7e8-49c8-a113-4e3f5ab05886 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:42:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:08 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:42:08 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:42:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:08 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:42:08 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:42:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7a53d5ca-e7e8-49c8-a113-4e3f5ab05886 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:08 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7a53d5ca-e7e8-49c8-a113-4e3f5ab05886 1073741824 Sep 16 17:42:08 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:08 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-e738e394-da64-486d-bf55-fb80e65a4442 tempest-VolumesExtendTest-1053195174 None] Create snapshot completed successfully Sep 16 17:42:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e015c39d-68ea-4efb-9300-1a26a277ad37 tempest-AttachVolumeNegativeTest-195502489 None] Acquiring lock "cinder-871867ef-d231-4ff1-9a0c-9a19140c2c80-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e015c39d-68ea-4efb-9300-1a26a277ad37 tempest-AttachVolumeNegativeTest-195502489 None] Lock "cinder-871867ef-d231-4ff1-9a0c-9a19140c2c80-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e015c39d-68ea-4efb-9300-1a26a277ad37 tempest-AttachVolumeNegativeTest-195502489 None] Acquiring lock "cinder-quobyte-871867ef-d231-4ff1-9a0c-9a19140c2c80" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e015c39d-68ea-4efb-9300-1a26a277ad37 tempest-AttachVolumeNegativeTest-195502489 None] Lock "cinder-quobyte-871867ef-d231-4ff1-9a0c-9a19140c2c80" acquired by "delete_volume" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:08 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a8f1ad-b926-473f-b140-d7021209dd1e]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e015c39d-68ea-4efb-9300-1a26a277ad37 tempest-AttachVolumeNegativeTest-195502489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-871867ef-d231-4ff1-9a0c-9a19140c2c80 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:08 devstack sudo[93934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-871867ef-d231-4ff1-9a0c-9a19140c2c80 Sep 16 17:42:08 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:08 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7a53d5ca-e7e8-49c8-a113-4e3f5ab05886 1073741824" returned: 0 in 0.470s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7a53d5ca-e7e8-49c8-a113-4e3f5ab05886 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:08 devstack sudo[93939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7a53d5ca-e7e8-49c8-a113-4e3f5ab05886 Sep 16 17:42:08 devstack sudo[93939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:09 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e015c39d-68ea-4efb-9300-1a26a277ad37 tempest-AttachVolumeNegativeTest-195502489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-871867ef-d231-4ff1-9a0c-9a19140c2c80" returned: 0 in 0.413s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e015c39d-68ea-4efb-9300-1a26a277ad37 tempest-AttachVolumeNegativeTest-195502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-871867ef-d231-4ff1-9a0c-9a19140c2c80 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:09 devstack sudo[93944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-871867ef-d231-4ff1-9a0c-9a19140c2c80 Sep 16 17:42:09 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9a5b42c2-e997-4438-afbe-1285d2769b6a tempest-VolumesExtendTest-1053195174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:09 devstack sudo[93939]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7a53d5ca-e7e8-49c8-a113-4e3f5ab05886" returned: 0 in 0.336s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9a5b42c2-e997-4438-afbe-1285d2769b6a tempest-VolumesExtendTest-1053195174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.051s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19de70fc-b265-4a0b-b552-34e9cd2a3ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a53d5ca-e7e8-49c8-a113-4e3f5ab05886', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6faff5a8-38ad-4e16-a7a1-bc17381e5cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba6ff18-ccdd-4264-93f9-4a38b049391c]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9a5b42c2-e997-4438-afbe-1285d2769b6a tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:09 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Volume volume-7a53d5ca-e7e8-49c8-a113-4e3f5ab05886 (7a53d5ca-e7e8-49c8-a113-4e3f5ab05886): created successfully Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6faff5a8-38ad-4e16-a7a1-bc17381e5cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Flow 'volume_create_manager' (08cf961e-fe19-4c05-9da5-46bd5d0eb4b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:42:09 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-98ed118d-5256-46ac-9ee5-9ea3a354260f tempest-VolumesTransfersV357Test-629307909 None] Created volume successfully. Sep 16 17:42:09 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e015c39d-68ea-4efb-9300-1a26a277ad37 tempest-AttachVolumeNegativeTest-195502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-871867ef-d231-4ff1-9a0c-9a19140c2c80" returned: 0 in 0.315s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e015c39d-68ea-4efb-9300-1a26a277ad37 tempest-AttachVolumeNegativeTest-195502489 None] Lock "cinder-quobyte-871867ef-d231-4ff1-9a0c-9a19140c2c80" released by "delete_volume" :: held 0.789s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:09 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386 Sep 16 17:42:09 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-e015c39d-68ea-4efb-9300-1a26a277ad37 tempest-AttachVolumeNegativeTest-195502489 None] Created reservations ['5a723f72-46ae-4a98-95c5-503c5268b605', '3e10fbb2-c2f5-4fd1-a840-4df869eccaad', '7b3b0c20-f928-4251-b4b2-50d719af84c7', 'dfb0279e-86e0-4206-96cf-c76a02429f20'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e015c39d-68ea-4efb-9300-1a26a277ad37 tempest-AttachVolumeNegativeTest-195502489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e015c39d-68ea-4efb-9300-1a26a277ad37 tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e015c39d-68ea-4efb-9300-1a26a277ad37 tempest-AttachVolumeNegativeTest-195502489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e015c39d-68ea-4efb-9300-1a26a277ad37 tempest-AttachVolumeNegativeTest-195502489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e015c39d-68ea-4efb-9300-1a26a277ad37 tempest-AttachVolumeNegativeTest-195502489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e015c39d-68ea-4efb-9300-1a26a277ad37 tempest-AttachVolumeNegativeTest-195502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:09 devstack sudo[93950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:42:09 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:09 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9a5b42c2-e997-4438-afbe-1285d2769b6a tempest-VolumesExtendTest-1053195174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386" returned: 0 in 0.480s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9a5b42c2-e997-4438-afbe-1285d2769b6a tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.b8ca2698-011d-43f0-aadc-2f2d038ee263 2G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:09 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e015c39d-68ea-4efb-9300-1a26a277ad37 tempest-AttachVolumeNegativeTest-195502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.409s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-e015c39d-68ea-4efb-9300-1a26a277ad37 tempest-AttachVolumeNegativeTest-195502489 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:42:09 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-e015c39d-68ea-4efb-9300-1a26a277ad37 tempest-AttachVolumeNegativeTest-195502489 None] Deleted volume successfully. Sep 16 17:42:09 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e015c39d-68ea-4efb-9300-1a26a277ad37 tempest-AttachVolumeNegativeTest-195502489 None] Lock "cinder-871867ef-d231-4ff1-9a0c-9a19140c2c80-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9a5b42c2-e997-4438-afbe-1285d2769b6a tempest-VolumesExtendTest-1053195174 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.b8ca2698-011d-43f0-aadc-2f2d038ee263 2G" returned: 0 in 0.251s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9a5b42c2-e997-4438-afbe-1285d2769b6a tempest-VolumesExtendTest-1053195174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.796s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:10 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-9a5b42c2-e997-4438-afbe-1285d2769b6a tempest-VolumesExtendTest-1053195174 None] Extend volume completed successfully. Sep 16 17:42:10 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cbffadfb-4742-42e8-b909-34278ae2dd5e tempest-VolumesTransfersV357Test-448147750 None] Acquiring lock "cinder-7a53d5ca-e7e8-49c8-a113-4e3f5ab05886-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:10 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cbffadfb-4742-42e8-b909-34278ae2dd5e tempest-VolumesTransfersV357Test-448147750 None] Lock "cinder-7a53d5ca-e7e8-49c8-a113-4e3f5ab05886-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:10 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cbffadfb-4742-42e8-b909-34278ae2dd5e tempest-VolumesTransfersV357Test-448147750 None] Acquiring lock "cinder-quobyte-7a53d5ca-e7e8-49c8-a113-4e3f5ab05886" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:10 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cbffadfb-4742-42e8-b909-34278ae2dd5e tempest-VolumesTransfersV357Test-448147750 None] Lock "cinder-quobyte-7a53d5ca-e7e8-49c8-a113-4e3f5ab05886" acquired by "delete_volume" :: waited 0.026s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:10 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2d4f5a-c48e-4673-a784-45618658227b]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cbffadfb-4742-42e8-b909-34278ae2dd5e tempest-VolumesTransfersV357Test-448147750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7a53d5ca-e7e8-49c8-a113-4e3f5ab05886 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:10 devstack sudo[93960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7a53d5ca-e7e8-49c8-a113-4e3f5ab05886 Sep 16 17:42:10 devstack sudo[93960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:10 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4fd0a9c9-7acd-4eb3-8762-fb1d55da2773 tempest-VolumesExtendTest-1053195174 None] Acquiring lock "cinder-b8ca2698-011d-43f0-aadc-2f2d038ee263-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:10 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4fd0a9c9-7acd-4eb3-8762-fb1d55da2773 tempest-VolumesExtendTest-1053195174 None] Lock "cinder-b8ca2698-011d-43f0-aadc-2f2d038ee263-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:10 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4fd0a9c9-7acd-4eb3-8762-fb1d55da2773 tempest-VolumesExtendTest-1053195174 None] Acquiring lock "cinder-quobyte-d1c8da6c-fb91-4f72-a312-b1d7ec906386" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:10 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4fd0a9c9-7acd-4eb3-8762-fb1d55da2773 tempest-VolumesExtendTest-1053195174 None] Lock "cinder-quobyte-d1c8da6c-fb91-4f72-a312-b1d7ec906386" acquired by "delete_snapshot" :: waited 0.060s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:10 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4fd0a9c9-7acd-4eb3-8762-fb1d55da2773 tempest-VolumesExtendTest-1053195174 None] Acquiring lock "cinder-quobyte-b8ca2698-011d-43f0-aadc-2f2d038ee263" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:10 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4fd0a9c9-7acd-4eb3-8762-fb1d55da2773 tempest-VolumesExtendTest-1053195174 None] Lock "cinder-quobyte-b8ca2698-011d-43f0-aadc-2f2d038ee263" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-4fd0a9c9-7acd-4eb3-8762-fb1d55da2773 tempest-VolumesExtendTest-1053195174 None] Deleting offline snapshot b8ca2698-011d-43f0-aadc-2f2d038ee263 of volume d1c8da6c-fb91-4f72-a312-b1d7ec906386 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:42:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-4fd0a9c9-7acd-4eb3-8762-fb1d55da2773 tempest-VolumesExtendTest-1053195174 None] snapshot_file for this snap is: volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.b8ca2698-011d-43f0-aadc-2f2d038ee263 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:42:10 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacb38cd-3759-480d-aa20-909a8e54932d]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fd0a9c9-7acd-4eb3-8762-fb1d55da2773 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.b8ca2698-011d-43f0-aadc-2f2d038ee263 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:10 devstack sudo[93960]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:10 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.b8ca2698-011d-43f0-aadc-2f2d038ee263 Sep 16 17:42:10 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cbffadfb-4742-42e8-b909-34278ae2dd5e tempest-VolumesTransfersV357Test-448147750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7a53d5ca-e7e8-49c8-a113-4e3f5ab05886" returned: 0 in 0.605s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cbffadfb-4742-42e8-b909-34278ae2dd5e tempest-VolumesTransfersV357Test-448147750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7a53d5ca-e7e8-49c8-a113-4e3f5ab05886 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:11 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7a53d5ca-e7e8-49c8-a113-4e3f5ab05886 Sep 16 17:42:11 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:11 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fd0a9c9-7acd-4eb3-8762-fb1d55da2773 tempest-VolumesExtendTest-1053195174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.b8ca2698-011d-43f0-aadc-2f2d038ee263" returned: 0 in 0.510s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-4fd0a9c9-7acd-4eb3-8762-fb1d55da2773 tempest-VolumesExtendTest-1053195174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:42:11 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f61fcde-9828-4b97-92c0-0bf7cd2f9025]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fd0a9c9-7acd-4eb3-8762-fb1d55da2773 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:11 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cbffadfb-4742-42e8-b909-34278ae2dd5e tempest-VolumesTransfersV357Test-448147750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7a53d5ca-e7e8-49c8-a113-4e3f5ab05886" returned: 0 in 0.350s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:11 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cbffadfb-4742-42e8-b909-34278ae2dd5e tempest-VolumesTransfersV357Test-448147750 None] Lock "cinder-quobyte-7a53d5ca-e7e8-49c8-a113-4e3f5ab05886" released by "delete_volume" :: held 1.033s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:11 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-cbffadfb-4742-42e8-b909-34278ae2dd5e tempest-VolumesTransfersV357Test-448147750 None] Created reservations ['70a60950-cb72-41ea-a1bc-4ee9455cbb3b', '516ed467-f789-4c42-8090-b5bf63fe9b33', 'ba5169ed-02e1-48eb-8ffb-19514f856f76', '46a790b2-78af-475e-81ed-ada9b87cc9a5'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:42:11 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386 Sep 16 17:42:11 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cbffadfb-4742-42e8-b909-34278ae2dd5e tempest-VolumesTransfersV357Test-448147750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cbffadfb-4742-42e8-b909-34278ae2dd5e tempest-VolumesTransfersV357Test-448147750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cbffadfb-4742-42e8-b909-34278ae2dd5e tempest-VolumesTransfersV357Test-448147750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:42:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cbffadfb-4742-42e8-b909-34278ae2dd5e tempest-VolumesTransfersV357Test-448147750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:42:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cbffadfb-4742-42e8-b909-34278ae2dd5e tempest-VolumesTransfersV357Test-448147750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cbffadfb-4742-42e8-b909-34278ae2dd5e tempest-VolumesTransfersV357Test-448147750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:11 devstack sudo[93977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:42:11 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:11 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fd0a9c9-7acd-4eb3-8762-fb1d55da2773 tempest-VolumesExtendTest-1053195174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386" returned: 0 in 0.671s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fd0a9c9-7acd-4eb3-8762-fb1d55da2773 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.b8ca2698-011d-43f0-aadc-2f2d038ee263 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:12 devstack sudo[93985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.b8ca2698-011d-43f0-aadc-2f2d038ee263 Sep 16 17:42:12 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:12 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cbffadfb-4742-42e8-b909-34278ae2dd5e tempest-VolumesTransfersV357Test-448147750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.499s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:12 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-cbffadfb-4742-42e8-b909-34278ae2dd5e tempest-VolumesTransfersV357Test-448147750 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:42:12 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-cbffadfb-4742-42e8-b909-34278ae2dd5e tempest-VolumesTransfersV357Test-448147750 None] Deleted volume successfully. Sep 16 17:42:12 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cbffadfb-4742-42e8-b909-34278ae2dd5e tempest-VolumesTransfersV357Test-448147750 None] Lock "cinder-7a53d5ca-e7e8-49c8-a113-4e3f5ab05886-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:12 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fd0a9c9-7acd-4eb3-8762-fb1d55da2773 tempest-VolumesExtendTest-1053195174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.b8ca2698-011d-43f0-aadc-2f2d038ee263" returned: 0 in 0.689s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fd0a9c9-7acd-4eb3-8762-fb1d55da2773 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.b8ca2698-011d-43f0-aadc-2f2d038ee263 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:12 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.b8ca2698-011d-43f0-aadc-2f2d038ee263 Sep 16 17:42:12 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:12 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fd0a9c9-7acd-4eb3-8762-fb1d55da2773 tempest-VolumesExtendTest-1053195174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386.b8ca2698-011d-43f0-aadc-2f2d038ee263" returned: 0 in 0.352s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:13 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4fd0a9c9-7acd-4eb3-8762-fb1d55da2773 tempest-VolumesExtendTest-1053195174 None] Lock "cinder-quobyte-b8ca2698-011d-43f0-aadc-2f2d038ee263" released by "_delete_snapshot" :: held 2.370s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:13 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4fd0a9c9-7acd-4eb3-8762-fb1d55da2773 tempest-VolumesExtendTest-1053195174 None] Lock "cinder-quobyte-d1c8da6c-fb91-4f72-a312-b1d7ec906386" released by "delete_snapshot" :: held 2.411s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:13 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-4fd0a9c9-7acd-4eb3-8762-fb1d55da2773 tempest-VolumesExtendTest-1053195174 None] Created reservations ['b22883ca-3b3f-42fb-992b-6fbf7ecb51f3', 'd41439e7-1121-4e2e-b9cf-40e07ded65e4', '758d5401-5ce5-488c-ba5a-3b37f81a9f21', '7fa66d6f-c83e-4659-8ee4-cfb9f486adfb'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:42:13 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-4fd0a9c9-7acd-4eb3-8762-fb1d55da2773 tempest-VolumesExtendTest-1053195174 None] Delete snapshot completed successfully. Sep 16 17:42:13 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4fd0a9c9-7acd-4eb3-8762-fb1d55da2773 tempest-VolumesExtendTest-1053195174 None] Lock "cinder-b8ca2698-011d-43f0-aadc-2f2d038ee263-delete_snapshot" released by "delete_snapshot" :: held 2.674s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:13 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fd9e345a-6d5a-49e1-ab0d-1139733c38f2 tempest-VolumesExtendTest-1053195174 None] Acquiring lock "cinder-d1c8da6c-fb91-4f72-a312-b1d7ec906386-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:14 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fd9e345a-6d5a-49e1-ab0d-1139733c38f2 tempest-VolumesExtendTest-1053195174 None] Lock "cinder-d1c8da6c-fb91-4f72-a312-b1d7ec906386-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:14 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fd9e345a-6d5a-49e1-ab0d-1139733c38f2 tempest-VolumesExtendTest-1053195174 None] Acquiring lock "cinder-quobyte-d1c8da6c-fb91-4f72-a312-b1d7ec906386" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:14 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fd9e345a-6d5a-49e1-ab0d-1139733c38f2 tempest-VolumesExtendTest-1053195174 None] Lock "cinder-quobyte-d1c8da6c-fb91-4f72-a312-b1d7ec906386" acquired by "delete_volume" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:14 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5b835e-6248-4af0-b60f-e9c26d5a6931]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fd9e345a-6d5a-49e1-ab0d-1139733c38f2 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:14 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386 Sep 16 17:42:14 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:14 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fd9e345a-6d5a-49e1-ab0d-1139733c38f2 tempest-VolumesExtendTest-1053195174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386" returned: 0 in 0.649s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fd9e345a-6d5a-49e1-ab0d-1139733c38f2 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:14 devstack sudo[94006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386 Sep 16 17:42:14 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:15 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fd9e345a-6d5a-49e1-ab0d-1139733c38f2 tempest-VolumesExtendTest-1053195174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d1c8da6c-fb91-4f72-a312-b1d7ec906386" returned: 0 in 0.416s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:15 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fd9e345a-6d5a-49e1-ab0d-1139733c38f2 tempest-VolumesExtendTest-1053195174 None] Lock "cinder-quobyte-d1c8da6c-fb91-4f72-a312-b1d7ec906386" released by "delete_volume" :: held 1.152s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:15 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-fd9e345a-6d5a-49e1-ab0d-1139733c38f2 tempest-VolumesExtendTest-1053195174 None] Created reservations ['a0df8a78-99fd-4615-a4b4-51416f2216a0', '24ad78ee-71ee-4e48-8ac9-69b488530804', '46c42454-d6a8-4640-ad06-1263f95482b5', '8c43bc69-7456-4866-a588-fc3c33c6fa78'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:42:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fd9e345a-6d5a-49e1-ab0d-1139733c38f2 tempest-VolumesExtendTest-1053195174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fd9e345a-6d5a-49e1-ab0d-1139733c38f2 tempest-VolumesExtendTest-1053195174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fd9e345a-6d5a-49e1-ab0d-1139733c38f2 tempest-VolumesExtendTest-1053195174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:42:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fd9e345a-6d5a-49e1-ab0d-1139733c38f2 tempest-VolumesExtendTest-1053195174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:42:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fd9e345a-6d5a-49e1-ab0d-1139733c38f2 tempest-VolumesExtendTest-1053195174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fd9e345a-6d5a-49e1-ab0d-1139733c38f2 tempest-VolumesExtendTest-1053195174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:15 devstack sudo[94009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:42:15 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:15 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fd9e345a-6d5a-49e1-ab0d-1139733c38f2 tempest-VolumesExtendTest-1053195174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.307s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:15 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-fd9e345a-6d5a-49e1-ab0d-1139733c38f2 tempest-VolumesExtendTest-1053195174 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:42:15 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-fd9e345a-6d5a-49e1-ab0d-1139733c38f2 tempest-VolumesExtendTest-1053195174 None] Deleted volume successfully. Sep 16 17:42:15 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fd9e345a-6d5a-49e1-ab0d-1139733c38f2 tempest-VolumesExtendTest-1053195174 None] Lock "cinder-d1c8da6c-fb91-4f72-a312-b1d7ec906386-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:20 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:42:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Flow 'volume_create_manager' (c9e6801d-3494-4fb7-a1d5-6c6cbd469848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:42:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ddd3a0-66f5-42c8-adec-b142e1eeeef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ddd3a0-66f5-42c8-adec-b142e1eeeef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-671571785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75690c45-47c6-4cc4-a983-732327ac0b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76f8d1516694f278675b98ab52b5fe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:42:20Z,use_quota=True,user_id='3651624f390e409da73910cf83cce292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d91adb-bfc3-4bef-9c76-a90df3d055b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d91adb-bfc3-4bef-9c76-a90df3d055b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67e9924-c85a-49af-b56c-1c02f22102e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67e9924-c85a-49af-b56c-1c02f22102e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75690c45-47c6-4cc4-a983-732327ac0b0f', 'volume_name': 'volume-75690c45-47c6-4cc4-a983-732327ac0b0f', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59a3b114-f4cb-48c0-a3aa-a8afd21b583b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59a3b114-f4cb-48c0-a3aa-a8afd21b583b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58be8e21-f6bb-4e58-8fd4-7536125c0297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:20 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Volume 75690c45-47c6-4cc4-a983-732327ac0b0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75690c45-47c6-4cc4-a983-732327ac0b0f', 'volume_size': 1} Sep 16 17:42:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-671571785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75690c45-47c6-4cc4-a983-732327ac0b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76f8d1516694f278675b98ab52b5fe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:42:20Z,use_quota=True,user_id='3651624f390e409da73910cf83cce292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:42:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Creating volume 75690c45-47c6-4cc4-a983-732327ac0b0f {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:42:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:42:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:42:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:42:20 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:42:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:20 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f 1073741824 Sep 16 17:42:20 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:20 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f 1073741824" returned: 0 in 0.586s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:21 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f Sep 16 17:42:21 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Flow 'volume_create_manager' (40a5a7e7-698b-49a6-a6f5-6f0c1c4168a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05df24c-79ac-4bb0-8ac4-058c1fcc065e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05df24c-79ac-4bb0-8ac4-058c1fcc065e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-848153963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ca395f-15d0-4164-a568-cfe8e2cfc786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efdb08cd52b403599e583ddd12225b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:42:21Z,use_quota=True,user_id='68d9b52e94b64068b5300c04f130c155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f66f118-a548-4841-9658-5bcb01bcbd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f66f118-a548-4841-9658-5bcb01bcbd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c1c5f6-9b6f-4dd1-ae3d-367b0452992d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c1c5f6-9b6f-4dd1-ae3d-367b0452992d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ca395f-15d0-4164-a568-cfe8e2cfc786', 'volume_name': 'volume-41ca395f-15d0-4164-a568-cfe8e2cfc786', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ec9f80-3b45-4036-8544-93c90b1fb6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ec9f80-3b45-4036-8544-93c90b1fb6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781b7f63-e11b-4456-9be9-c4281c8d08f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:21 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Volume 41ca395f-15d0-4164-a568-cfe8e2cfc786: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ca395f-15d0-4164-a568-cfe8e2cfc786', 'volume_size': 1} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:21 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f" returned: 0 in 0.352s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.101s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-848153963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ca395f-15d0-4164-a568-cfe8e2cfc786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efdb08cd52b403599e583ddd12225b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:42:21Z,use_quota=True,user_id='68d9b52e94b64068b5300c04f130c155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Creating volume 41ca395f-15d0-4164-a568-cfe8e2cfc786 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:42:21 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58be8e21-f6bb-4e58-8fd4-7536125c0297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75690c45-47c6-4cc4-a983-732327ac0b0f', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:21 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786 1073741824 Sep 16 17:42:21 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fe4143-9a3c-44c0-836e-5e3618aaf33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:21 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Volume volume-75690c45-47c6-4cc4-a983-732327ac0b0f (75690c45-47c6-4cc4-a983-732327ac0b0f): created successfully Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fe4143-9a3c-44c0-836e-5e3618aaf33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Flow 'volume_create_manager' (c9e6801d-3494-4fb7-a1d5-6c6cbd469848) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:42:21 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-5006a2a7-9e0d-40cf-9e74-ee9b8a482e7b req-7fa80429-7560-4377-b338-a612a09e959f tempest-VolumesSnapshotsTestJSON-561458140 None] Created volume successfully. Sep 16 17:42:21 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786 1073741824" returned: 0 in 0.495s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:21 devstack sudo[94030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786 Sep 16 17:42:21 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:22 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786" returned: 0 in 0.257s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:42:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781b7f63-e11b-4456-9be9-c4281c8d08f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ca395f-15d0-4164-a568-cfe8e2cfc786', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dcd5128-14ac-4bef-a7fd-4cbba7b8caac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:22 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Volume volume-41ca395f-15d0-4164-a568-cfe8e2cfc786 (41ca395f-15d0-4164-a568-cfe8e2cfc786): created successfully Sep 16 17:42:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dcd5128-14ac-4bef-a7fd-4cbba7b8caac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Flow 'volume_create_manager' (40a5a7e7-698b-49a6-a6f5-6f0c1c4168a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:42:22 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-62784f41-30a6-4909-bbe7-da117224f111 tempest-VolumesSnapshotListTestJSON-143198315 None] Created volume successfully. Sep 16 17:42:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-c216c7a8-11df-4a3b-ac09-63909edbc80f req-4c1d7c90-9dac-4261-b74e-a9cd8028d7a4 tempest-VolumesSnapshotsTestJSON-561458140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-c216c7a8-11df-4a3b-ac09-63909edbc80f req-4c1d7c90-9dac-4261-b74e-a9cd8028d7a4 tempest-VolumesSnapshotsTestJSON-561458140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [req-c216c7a8-11df-4a3b-ac09-63909edbc80f req-4c1d7c90-9dac-4261-b74e-a9cd8028d7a4 tempest-VolumesSnapshotsTestJSON-561458140 None] Creating offline snapshot 8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a of volume 75690c45-47c6-4cc4-a983-732327ac0b0f {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:42:22 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ce02e2-da93-4fcf-a3f0-3789ce709314]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-c216c7a8-11df-4a3b-ac09-63909edbc80f req-4c1d7c90-9dac-4261-b74e-a9cd8028d7a4 tempest-VolumesSnapshotsTestJSON-561458140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:22 devstack sudo[94033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f Sep 16 17:42:22 devstack sudo[94033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:23 devstack sudo[94033]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-c216c7a8-11df-4a3b-ac09-63909edbc80f req-4c1d7c90-9dac-4261-b74e-a9cd8028d7a4 tempest-VolumesSnapshotsTestJSON-561458140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f" returned: 0 in 0.567s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-c216c7a8-11df-4a3b-ac09-63909edbc80f req-4c1d7c90-9dac-4261-b74e-a9cd8028d7a4 tempest-VolumesSnapshotsTestJSON-561458140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:23 devstack sudo[94039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a 1G Sep 16 17:42:23 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-82e2c47d-3c16-4aef-b28f-3579b0fef330 tempest-VolumesSnapshotListTestJSON-143198315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:23 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-c216c7a8-11df-4a3b-ac09-63909edbc80f req-4c1d7c90-9dac-4261-b74e-a9cd8028d7a4 tempest-VolumesSnapshotsTestJSON-561458140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a 1G" returned: 0 in 0.576s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-c216c7a8-11df-4a3b-ac09-63909edbc80f req-4c1d7c90-9dac-4261-b74e-a9cd8028d7a4 tempest-VolumesSnapshotsTestJSON-561458140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75690c45-47c6-4cc4-a983-732327ac0b0f -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:23 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75690c45-47c6-4cc4-a983-732327ac0b0f -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a Sep 16 17:42:23 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:24 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-c216c7a8-11df-4a3b-ac09-63909edbc80f req-4c1d7c90-9dac-4261-b74e-a9cd8028d7a4 tempest-VolumesSnapshotsTestJSON-561458140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75690c45-47c6-4cc4-a983-732327ac0b0f -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a" returned: 0 in 0.301s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:24 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [req-c216c7a8-11df-4a3b-ac09-63909edbc80f req-4c1d7c90-9dac-4261-b74e-a9cd8028d7a4 tempest-VolumesSnapshotsTestJSON-561458140 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a is being set with open permissions: ugo+rw Sep 16 17:42:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-c216c7a8-11df-4a3b-ac09-63909edbc80f req-4c1d7c90-9dac-4261-b74e-a9cd8028d7a4 tempest-VolumesSnapshotsTestJSON-561458140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:24 devstack sudo[94050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a Sep 16 17:42:24 devstack sudo[94050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:24 devstack sudo[94050]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-c216c7a8-11df-4a3b-ac09-63909edbc80f req-4c1d7c90-9dac-4261-b74e-a9cd8028d7a4 tempest-VolumesSnapshotsTestJSON-561458140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a" returned: 0 in 0.270s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-c216c7a8-11df-4a3b-ac09-63909edbc80f req-4c1d7c90-9dac-4261-b74e-a9cd8028d7a4 tempest-VolumesSnapshotsTestJSON-561458140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:24 devstack sudo[94055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.info Sep 16 17:42:24 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:24 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-c216c7a8-11df-4a3b-ac09-63909edbc80f req-4c1d7c90-9dac-4261-b74e-a9cd8028d7a4 tempest-VolumesSnapshotsTestJSON-561458140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.info" returned: 0 in 0.304s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:24 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [req-c216c7a8-11df-4a3b-ac09-63909edbc80f req-4c1d7c90-9dac-4261-b74e-a9cd8028d7a4 tempest-VolumesSnapshotsTestJSON-561458140 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.info is being set with open permissions: ugo+rw Sep 16 17:42:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-c216c7a8-11df-4a3b-ac09-63909edbc80f req-4c1d7c90-9dac-4261-b74e-a9cd8028d7a4 tempest-VolumesSnapshotsTestJSON-561458140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:24 devstack sudo[94059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.info Sep 16 17:42:24 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:25 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-c216c7a8-11df-4a3b-ac09-63909edbc80f req-4c1d7c90-9dac-4261-b74e-a9cd8028d7a4 tempest-VolumesSnapshotsTestJSON-561458140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.info" returned: 0 in 0.385s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-c216c7a8-11df-4a3b-ac09-63909edbc80f req-4c1d7c90-9dac-4261-b74e-a9cd8028d7a4 tempest-VolumesSnapshotsTestJSON-561458140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.564s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-82e2c47d-3c16-4aef-b28f-3579b0fef330 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.687s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-82e2c47d-3c16-4aef-b28f-3579b0fef330 tempest-VolumesSnapshotListTestJSON-143198315 None] Creating offline snapshot 0c7d9e37-f97e-4945-adc9-a825874529d3 of volume 41ca395f-15d0-4164-a568-cfe8e2cfc786 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:42:25 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-c216c7a8-11df-4a3b-ac09-63909edbc80f req-4c1d7c90-9dac-4261-b74e-a9cd8028d7a4 tempest-VolumesSnapshotsTestJSON-561458140 None] Create snapshot completed successfully Sep 16 17:42:25 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0c5572-08bd-459f-86fb-4d1d86aa47e2]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-82e2c47d-3c16-4aef-b28f-3579b0fef330 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-29cfc588-a08c-4873-8281-dedd1ff94648 req-125454c1-310d-498e-8e02-0c1fb8eb9ee6 tempest-VolumesSnapshotsTestJSON-561458140 None] Acquiring lock "cinder-8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-29cfc588-a08c-4873-8281-dedd1ff94648 req-125454c1-310d-498e-8e02-0c1fb8eb9ee6 tempest-VolumesSnapshotsTestJSON-561458140 None] Lock "cinder-8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-29cfc588-a08c-4873-8281-dedd1ff94648 req-125454c1-310d-498e-8e02-0c1fb8eb9ee6 tempest-VolumesSnapshotsTestJSON-561458140 None] Acquiring lock "cinder-quobyte-75690c45-47c6-4cc4-a983-732327ac0b0f" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-29cfc588-a08c-4873-8281-dedd1ff94648 req-125454c1-310d-498e-8e02-0c1fb8eb9ee6 tempest-VolumesSnapshotsTestJSON-561458140 None] Lock "cinder-quobyte-75690c45-47c6-4cc4-a983-732327ac0b0f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-29cfc588-a08c-4873-8281-dedd1ff94648 req-125454c1-310d-498e-8e02-0c1fb8eb9ee6 tempest-VolumesSnapshotsTestJSON-561458140 None] Acquiring lock "cinder-quobyte-8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-29cfc588-a08c-4873-8281-dedd1ff94648 req-125454c1-310d-498e-8e02-0c1fb8eb9ee6 tempest-VolumesSnapshotsTestJSON-561458140 None] Lock "cinder-quobyte-8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:25 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786 Sep 16 17:42:25 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [req-29cfc588-a08c-4873-8281-dedd1ff94648 req-125454c1-310d-498e-8e02-0c1fb8eb9ee6 tempest-VolumesSnapshotsTestJSON-561458140 None] Deleting offline snapshot 8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a of volume 75690c45-47c6-4cc4-a983-732327ac0b0f {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:42:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [req-29cfc588-a08c-4873-8281-dedd1ff94648 req-125454c1-310d-498e-8e02-0c1fb8eb9ee6 tempest-VolumesSnapshotsTestJSON-561458140 None] snapshot_file for this snap is: volume-75690c45-47c6-4cc4-a983-732327ac0b0f.8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:42:25 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95edd87-8fef-40b3-8bf8-460347a0c940]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-29cfc588-a08c-4873-8281-dedd1ff94648 req-125454c1-310d-498e-8e02-0c1fb8eb9ee6 tempest-VolumesSnapshotsTestJSON-561458140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:25 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a Sep 16 17:42:25 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:26 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-82e2c47d-3c16-4aef-b28f-3579b0fef330 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786" returned: 0 in 0.600s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-82e2c47d-3c16-4aef-b28f-3579b0fef330 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:26 devstack sudo[94093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3 1G Sep 16 17:42:26 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:26 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-29cfc588-a08c-4873-8281-dedd1ff94648 req-125454c1-310d-498e-8e02-0c1fb8eb9ee6 tempest-VolumesSnapshotsTestJSON-561458140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a" returned: 0 in 0.498s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [req-29cfc588-a08c-4873-8281-dedd1ff94648 req-125454c1-310d-498e-8e02-0c1fb8eb9ee6 tempest-VolumesSnapshotsTestJSON-561458140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75690c45-47c6-4cc4-a983-732327ac0b0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:42:26 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e989ea8-317b-41d2-8ddd-71dceceff4be]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-29cfc588-a08c-4873-8281-dedd1ff94648 req-125454c1-310d-498e-8e02-0c1fb8eb9ee6 tempest-VolumesSnapshotsTestJSON-561458140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:26 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f Sep 16 17:42:26 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:26 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-82e2c47d-3c16-4aef-b28f-3579b0fef330 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3 1G" returned: 0 in 0.555s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-82e2c47d-3c16-4aef-b28f-3579b0fef330 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ca395f-15d0-4164-a568-cfe8e2cfc786 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:26 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ca395f-15d0-4164-a568-cfe8e2cfc786 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3 Sep 16 17:42:26 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:26 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-29cfc588-a08c-4873-8281-dedd1ff94648 req-125454c1-310d-498e-8e02-0c1fb8eb9ee6 tempest-VolumesSnapshotsTestJSON-561458140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f" returned: 0 in 0.578s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-29cfc588-a08c-4873-8281-dedd1ff94648 req-125454c1-310d-498e-8e02-0c1fb8eb9ee6 tempest-VolumesSnapshotsTestJSON-561458140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:26 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a Sep 16 17:42:26 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:27 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-82e2c47d-3c16-4aef-b28f-3579b0fef330 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ca395f-15d0-4164-a568-cfe8e2cfc786 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3" returned: 0 in 0.470s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:27 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-82e2c47d-3c16-4aef-b28f-3579b0fef330 tempest-VolumesSnapshotListTestJSON-143198315 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3 is being set with open permissions: ugo+rw Sep 16 17:42:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-82e2c47d-3c16-4aef-b28f-3579b0fef330 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:27 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3 Sep 16 17:42:27 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:27 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-29cfc588-a08c-4873-8281-dedd1ff94648 req-125454c1-310d-498e-8e02-0c1fb8eb9ee6 tempest-VolumesSnapshotsTestJSON-561458140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a" returned: 0 in 0.466s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-29cfc588-a08c-4873-8281-dedd1ff94648 req-125454c1-310d-498e-8e02-0c1fb8eb9ee6 tempest-VolumesSnapshotsTestJSON-561458140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:27 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a Sep 16 17:42:27 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:27 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-82e2c47d-3c16-4aef-b28f-3579b0fef330 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3" returned: 0 in 0.353s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:27 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:UPDATE=143,cinder:SELECT=118,cinder:DELETE=14,cinder:INSERT=40 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:42:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-82e2c47d-3c16-4aef-b28f-3579b0fef330 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:27 devstack sudo[94125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.info Sep 16 17:42:27 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:27 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-29cfc588-a08c-4873-8281-dedd1ff94648 req-125454c1-310d-498e-8e02-0c1fb8eb9ee6 tempest-VolumesSnapshotsTestJSON-561458140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f.8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a" returned: 0 in 0.376s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:27 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-29cfc588-a08c-4873-8281-dedd1ff94648 req-125454c1-310d-498e-8e02-0c1fb8eb9ee6 tempest-VolumesSnapshotsTestJSON-561458140 None] Lock "cinder-quobyte-8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a" released by "_delete_snapshot" :: held 2.138s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:27 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:27 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-29cfc588-a08c-4873-8281-dedd1ff94648 req-125454c1-310d-498e-8e02-0c1fb8eb9ee6 tempest-VolumesSnapshotsTestJSON-561458140 None] Lock "cinder-quobyte-75690c45-47c6-4cc4-a983-732327ac0b0f" released by "delete_snapshot" :: held 2.175s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-82e2c47d-3c16-4aef-b28f-3579b0fef330 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.info" returned: 0 in 0.346s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:27 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-82e2c47d-3c16-4aef-b28f-3579b0fef330 tempest-VolumesSnapshotListTestJSON-143198315 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.info is being set with open permissions: ugo+rw Sep 16 17:42:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-82e2c47d-3c16-4aef-b28f-3579b0fef330 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:27 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.info Sep 16 17:42:27 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:27 devstack cinder-volume[85899]: DEBUG cinder.quota [req-29cfc588-a08c-4873-8281-dedd1ff94648 req-125454c1-310d-498e-8e02-0c1fb8eb9ee6 tempest-VolumesSnapshotsTestJSON-561458140 None] Created reservations ['cd344cca-8fef-4dec-8abd-ddb6ff5f0e37', '0a6577ba-bae5-45ae-866b-a0496b4630b7', 'd1ece8ce-9e9a-4549-8fed-da20d14b51a7', '15230b52-80c1-4c10-95b0-92727458bfd4'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:42:28 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-29cfc588-a08c-4873-8281-dedd1ff94648 req-125454c1-310d-498e-8e02-0c1fb8eb9ee6 tempest-VolumesSnapshotsTestJSON-561458140 None] Delete snapshot completed successfully. Sep 16 17:42:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-29cfc588-a08c-4873-8281-dedd1ff94648 req-125454c1-310d-498e-8e02-0c1fb8eb9ee6 tempest-VolumesSnapshotsTestJSON-561458140 None] Lock "cinder-8dc89735-41d1-4de8-b3ab-d5fbf8d7df5a-delete_snapshot" released by "delete_snapshot" :: held 2.449s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:28 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-82e2c47d-3c16-4aef-b28f-3579b0fef330 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.info" returned: 0 in 0.341s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-82e2c47d-3c16-4aef-b28f-3579b0fef330 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.898s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:28 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-82e2c47d-3c16-4aef-b28f-3579b0fef330 tempest-VolumesSnapshotListTestJSON-143198315 None] Create snapshot completed successfully Sep 16 17:42:29 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-708d0124-c85e-4733-8337-91f501d02c58 req-644062d2-fd1e-41e6-8ad1-d4abb9500a17 tempest-VolumesSnapshotsTestJSON-561458140 None] Acquiring lock "cinder-75690c45-47c6-4cc4-a983-732327ac0b0f-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:29 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-708d0124-c85e-4733-8337-91f501d02c58 req-644062d2-fd1e-41e6-8ad1-d4abb9500a17 tempest-VolumesSnapshotsTestJSON-561458140 None] Lock "cinder-75690c45-47c6-4cc4-a983-732327ac0b0f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3f33207e-4439-466c-8ccd-314d7c80a7a3 tempest-VolumesSnapshotListTestJSON-143198315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3f33207e-4439-466c-8ccd-314d7c80a7a3 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-3f33207e-4439-466c-8ccd-314d7c80a7a3 tempest-VolumesSnapshotListTestJSON-143198315 None] Creating offline snapshot 80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 of volume 41ca395f-15d0-4164-a568-cfe8e2cfc786 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:42:29 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67b6cc4-fc68-4cf6-8f35-8110abb12e46]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3f33207e-4439-466c-8ccd-314d7c80a7a3 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:29 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-708d0124-c85e-4733-8337-91f501d02c58 req-644062d2-fd1e-41e6-8ad1-d4abb9500a17 tempest-VolumesSnapshotsTestJSON-561458140 None] Acquiring lock "cinder-quobyte-75690c45-47c6-4cc4-a983-732327ac0b0f" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:29 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-708d0124-c85e-4733-8337-91f501d02c58 req-644062d2-fd1e-41e6-8ad1-d4abb9500a17 tempest-VolumesSnapshotsTestJSON-561458140 None] Lock "cinder-quobyte-75690c45-47c6-4cc4-a983-732327ac0b0f" acquired by "delete_volume" :: waited 0.038s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:29 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e34bd7-3c0c-4514-b5b2-5f8c91ac0cef]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-708d0124-c85e-4733-8337-91f501d02c58 req-644062d2-fd1e-41e6-8ad1-d4abb9500a17 tempest-VolumesSnapshotsTestJSON-561458140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:29 devstack sudo[94134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3 Sep 16 17:42:29 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:29 devstack sudo[94135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f Sep 16 17:42:29 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:29 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3f33207e-4439-466c-8ccd-314d7c80a7a3 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3" returned: 0 in 0.485s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-3f33207e-4439-466c-8ccd-314d7c80a7a3 tempest-VolumesSnapshotListTestJSON-143198315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41ca395f-15d0-4164-a568-cfe8e2cfc786(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:42:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3f33207e-4439-466c-8ccd-314d7c80a7a3 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:29 devstack sudo[94141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 1G Sep 16 17:42:29 devstack sudo[94141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:30 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-708d0124-c85e-4733-8337-91f501d02c58 req-644062d2-fd1e-41e6-8ad1-d4abb9500a17 tempest-VolumesSnapshotsTestJSON-561458140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f" returned: 0 in 0.567s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-708d0124-c85e-4733-8337-91f501d02c58 req-644062d2-fd1e-41e6-8ad1-d4abb9500a17 tempest-VolumesSnapshotsTestJSON-561458140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:30 devstack sudo[94146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f Sep 16 17:42:30 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:30 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-708d0124-c85e-4733-8337-91f501d02c58 req-644062d2-fd1e-41e6-8ad1-d4abb9500a17 tempest-VolumesSnapshotsTestJSON-561458140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-75690c45-47c6-4cc4-a983-732327ac0b0f" returned: 0 in 0.478s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:30 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-708d0124-c85e-4733-8337-91f501d02c58 req-644062d2-fd1e-41e6-8ad1-d4abb9500a17 tempest-VolumesSnapshotsTestJSON-561458140 None] Lock "cinder-quobyte-75690c45-47c6-4cc4-a983-732327ac0b0f" released by "delete_volume" :: held 1.130s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:30 devstack sudo[94141]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3f33207e-4439-466c-8ccd-314d7c80a7a3 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 1G" returned: 0 in 0.762s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3f33207e-4439-466c-8ccd-314d7c80a7a3 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:30 devstack cinder-volume[85899]: DEBUG cinder.quota [req-708d0124-c85e-4733-8337-91f501d02c58 req-644062d2-fd1e-41e6-8ad1-d4abb9500a17 tempest-VolumesSnapshotsTestJSON-561458140 None] Created reservations ['e302be0f-db6c-472e-a76d-a83bac6625b1', '78998e49-8f1e-4a2e-b914-c1e7f12f7549', '086a557d-410a-471c-a64a-670bae563dfe', 'f0953a6f-0800-4c0d-ba63-d6976e06c1c9'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:42:30 devstack sudo[94153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 Sep 16 17:42:30 devstack sudo[94153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-708d0124-c85e-4733-8337-91f501d02c58 req-644062d2-fd1e-41e6-8ad1-d4abb9500a17 tempest-VolumesSnapshotsTestJSON-561458140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-708d0124-c85e-4733-8337-91f501d02c58 req-644062d2-fd1e-41e6-8ad1-d4abb9500a17 tempest-VolumesSnapshotsTestJSON-561458140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [req-708d0124-c85e-4733-8337-91f501d02c58 req-644062d2-fd1e-41e6-8ad1-d4abb9500a17 tempest-VolumesSnapshotsTestJSON-561458140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:42:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [req-708d0124-c85e-4733-8337-91f501d02c58 req-644062d2-fd1e-41e6-8ad1-d4abb9500a17 tempest-VolumesSnapshotsTestJSON-561458140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:42:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-708d0124-c85e-4733-8337-91f501d02c58 req-644062d2-fd1e-41e6-8ad1-d4abb9500a17 tempest-VolumesSnapshotsTestJSON-561458140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-708d0124-c85e-4733-8337-91f501d02c58 req-644062d2-fd1e-41e6-8ad1-d4abb9500a17 tempest-VolumesSnapshotsTestJSON-561458140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:30 devstack sudo[94156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:42:30 devstack sudo[94156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:31 devstack sudo[94153]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3f33207e-4439-466c-8ccd-314d7c80a7a3 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4" returned: 0 in 0.456s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:31 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-3f33207e-4439-466c-8ccd-314d7c80a7a3 tempest-VolumesSnapshotListTestJSON-143198315 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 is being set with open permissions: ugo+rw Sep 16 17:42:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3f33207e-4439-466c-8ccd-314d7c80a7a3 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:31 devstack sudo[94156]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-708d0124-c85e-4733-8337-91f501d02c58 req-644062d2-fd1e-41e6-8ad1-d4abb9500a17 tempest-VolumesSnapshotsTestJSON-561458140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.397s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:31 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 Sep 16 17:42:31 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:31 devstack cinder-volume[85899]: DEBUG cinder.manager [req-708d0124-c85e-4733-8337-91f501d02c58 req-644062d2-fd1e-41e6-8ad1-d4abb9500a17 tempest-VolumesSnapshotsTestJSON-561458140 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:42:31 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-708d0124-c85e-4733-8337-91f501d02c58 req-644062d2-fd1e-41e6-8ad1-d4abb9500a17 tempest-VolumesSnapshotsTestJSON-561458140 None] Deleted volume successfully. Sep 16 17:42:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-708d0124-c85e-4733-8337-91f501d02c58 req-644062d2-fd1e-41e6-8ad1-d4abb9500a17 tempest-VolumesSnapshotsTestJSON-561458140 None] Lock "cinder-75690c45-47c6-4cc4-a983-732327ac0b0f-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:31 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3f33207e-4439-466c-8ccd-314d7c80a7a3 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4" returned: 0 in 0.351s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3f33207e-4439-466c-8ccd-314d7c80a7a3 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.223s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:31 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-3f33207e-4439-466c-8ccd-314d7c80a7a3 tempest-VolumesSnapshotListTestJSON-143198315 None] Create snapshot completed successfully Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3cdb8ac4-2edc-44ab-93c8-2d641debfc24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Acquiring lock "cinder-b29dbd3a-4095-43d1-acb9-1a8ca8758831-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3cdb8ac4-2edc-44ab-93c8-2d641debfc24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Lock "cinder-b29dbd3a-4095-43d1-acb9-1a8ca8758831-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Flow 'volume_create_manager' (141118fe-9a34-4cd4-8fd8-36ff28cea88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7693cc71-c0da-4530-96ae-5886e5aeb7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7693cc71-c0da-4530-96ae-5886e5aeb7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-252565002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2109ac70-7ac7-4588-a7e9-5ecddd478aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888eb51b97d04bc3895bc5494736f243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:42:32Z,use_quota=True,user_id='7cb9f778365f4ad19c304faab39b5aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3709968e-3e51-491f-a804-0958a01b0625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3709968e-3e51-491f-a804-0958a01b0625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e0715a7-fda7-4f58-9a03-257fefd6c996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e0715a7-fda7-4f58-9a03-257fefd6c996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2109ac70-7ac7-4588-a7e9-5ecddd478aa5', 'volume_name': 'volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e820db88-81e3-49d7-a265-a1210d459c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e820db88-81e3-49d7-a265-a1210d459c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f622b98e-97af-45b0-a65b-0f6d3ce4eb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:32 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Volume 2109ac70-7ac7-4588-a7e9-5ecddd478aa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5', 'volume_size': 1} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-252565002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2109ac70-7ac7-4588-a7e9-5ecddd478aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888eb51b97d04bc3895bc5494736f243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:42:32Z,use_quota=True,user_id='7cb9f778365f4ad19c304faab39b5aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Creating volume 2109ac70-7ac7-4588-a7e9-5ecddd478aa5 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:42:32 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:32 devstack sudo[94165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 1073741824 Sep 16 17:42:32 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3cdb8ac4-2edc-44ab-93c8-2d641debfc24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Acquiring lock "cinder-quobyte-b29dbd3a-4095-43d1-acb9-1a8ca8758831" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3cdb8ac4-2edc-44ab-93c8-2d641debfc24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Lock "cinder-quobyte-b29dbd3a-4095-43d1-acb9-1a8ca8758831" acquired by "delete_volume" :: waited 0.031s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:UPDATE=153,cinder:DELETE=13,cinder:SELECT=132,cinder:INSERT=40 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0b9d92-6426-4024-b602-943a04e6a9f5]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3cdb8ac4-2edc-44ab-93c8-2d641debfc24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b29dbd3a-4095-43d1-acb9-1a8ca8758831 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93b7a65-7e7b-4969-895b-db17544e9a7d tempest-VolumesSnapshotListTestJSON-143198315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:32 devstack sudo[94167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b29dbd3a-4095-43d1-acb9-1a8ca8758831 Sep 16 17:42:32 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:32 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 1073741824" returned: 0 in 0.502s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:32 devstack sudo[94177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 Sep 16 17:42:32 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:33 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3cdb8ac4-2edc-44ab-93c8-2d641debfc24 tempest-AttachVolumeShelveTestJSON-2067139834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b29dbd3a-4095-43d1-acb9-1a8ca8758831" returned: 0 in 0.488s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3cdb8ac4-2edc-44ab-93c8-2d641debfc24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b29dbd3a-4095-43d1-acb9-1a8ca8758831 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:33 devstack sudo[94179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b29dbd3a-4095-43d1-acb9-1a8ca8758831 Sep 16 17:42:33 devstack sudo[94179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:33 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5" returned: 0 in 0.285s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93b7a65-7e7b-4969-895b-db17544e9a7d tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.691s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-b93b7a65-7e7b-4969-895b-db17544e9a7d tempest-VolumesSnapshotListTestJSON-143198315 None] Creating offline snapshot f172021c-91a4-4e59-91e4-48fd3bb67904 of volume 41ca395f-15d0-4164-a568-cfe8e2cfc786 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:42:33 devstack sudo[94179]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3cdb8ac4-2edc-44ab-93c8-2d641debfc24 tempest-AttachVolumeShelveTestJSON-2067139834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b29dbd3a-4095-43d1-acb9-1a8ca8758831" returned: 0 in 0.285s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f622b98e-97af-45b0-a65b-0f6d3ce4eb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e46f188-f58c-43be-a01c-bd15e88ce619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac2033f-ee38-42d1-ae8b-90d41c1d32f9]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93b7a65-7e7b-4969-895b-db17544e9a7d tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3cdb8ac4-2edc-44ab-93c8-2d641debfc24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Lock "cinder-quobyte-b29dbd3a-4095-43d1-acb9-1a8ca8758831" released by "delete_volume" :: held 0.877s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:33 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Volume volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 (2109ac70-7ac7-4588-a7e9-5ecddd478aa5): created successfully Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e46f188-f58c-43be-a01c-bd15e88ce619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Flow 'volume_create_manager' (141118fe-9a34-4cd4-8fd8-36ff28cea88b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:42:33 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-d6bb8fb7-cead-4750-8a6a-71dbe9855fd5 tempest-VolumesActionsTest-1412284646 None] Created volume successfully. Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-3cdb8ac4-2edc-44ab-93c8-2d641debfc24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Created reservations ['a4afb2e2-ede8-4d58-9b62-077cfb2f2422', '96e919de-dbf0-4885-8b31-4d12729b4ddb', '45170d7e-11a5-4d45-88b6-19ff59349f79', 'b4a51c60-05eb-4bac-a197-4a79ab942d52'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:42:33 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 Sep 16 17:42:33 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3cdb8ac4-2edc-44ab-93c8-2d641debfc24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3cdb8ac4-2edc-44ab-93c8-2d641debfc24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3cdb8ac4-2edc-44ab-93c8-2d641debfc24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3cdb8ac4-2edc-44ab-93c8-2d641debfc24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3cdb8ac4-2edc-44ab-93c8-2d641debfc24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3cdb8ac4-2edc-44ab-93c8-2d641debfc24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:33 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:42:33 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:33 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93b7a65-7e7b-4969-895b-db17544e9a7d tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4" returned: 0 in 0.447s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-b93b7a65-7e7b-4969-895b-db17544e9a7d tempest-VolumesSnapshotListTestJSON-143198315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41ca395f-15d0-4164-a568-cfe8e2cfc786(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93b7a65-7e7b-4969-895b-db17544e9a7d tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.f172021c-91a4-4e59-91e4-48fd3bb67904 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:33 devstack sudo[94191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.f172021c-91a4-4e59-91e4-48fd3bb67904 1G Sep 16 17:42:33 devstack sudo[94191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:33 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3cdb8ac4-2edc-44ab-93c8-2d641debfc24 tempest-AttachVolumeShelveTestJSON-2067139834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.296s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-3cdb8ac4-2edc-44ab-93c8-2d641debfc24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:42:33 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-3cdb8ac4-2edc-44ab-93c8-2d641debfc24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Deleted volume successfully. Sep 16 17:42:33 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3cdb8ac4-2edc-44ab-93c8-2d641debfc24 tempest-AttachVolumeShelveTestJSON-2067139834 None] Lock "cinder-b29dbd3a-4095-43d1-acb9-1a8ca8758831-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:34 devstack sudo[94191]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93b7a65-7e7b-4969-895b-db17544e9a7d tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.f172021c-91a4-4e59-91e4-48fd3bb67904 1G" returned: 0 in 0.508s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93b7a65-7e7b-4969-895b-db17544e9a7d tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.f172021c-91a4-4e59-91e4-48fd3bb67904 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:34 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.f172021c-91a4-4e59-91e4-48fd3bb67904 Sep 16 17:42:34 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:34 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93b7a65-7e7b-4969-895b-db17544e9a7d tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.f172021c-91a4-4e59-91e4-48fd3bb67904" returned: 0 in 0.383s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:34 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-b93b7a65-7e7b-4969-895b-db17544e9a7d tempest-VolumesSnapshotListTestJSON-143198315 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.f172021c-91a4-4e59-91e4-48fd3bb67904 is being set with open permissions: ugo+rw Sep 16 17:42:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93b7a65-7e7b-4969-895b-db17544e9a7d tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.f172021c-91a4-4e59-91e4-48fd3bb67904 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:34 devstack sudo[94202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.f172021c-91a4-4e59-91e4-48fd3bb67904 Sep 16 17:42:34 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:34 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93b7a65-7e7b-4969-895b-db17544e9a7d tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.f172021c-91a4-4e59-91e4-48fd3bb67904" returned: 0 in 0.319s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93b7a65-7e7b-4969-895b-db17544e9a7d tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.803s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:35 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-b93b7a65-7e7b-4969-895b-db17544e9a7d tempest-VolumesSnapshotListTestJSON-143198315 None] Create snapshot completed successfully Sep 16 17:42:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0963910f-0b4a-490d-aae7-b172ed6d4773 tempest-VolumesSnapshotListTestJSON-143198315 None] Acquiring lock "cinder-f172021c-91a4-4e59-91e4-48fd3bb67904-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0963910f-0b4a-490d-aae7-b172ed6d4773 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "cinder-f172021c-91a4-4e59-91e4-48fd3bb67904-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0963910f-0b4a-490d-aae7-b172ed6d4773 tempest-VolumesSnapshotListTestJSON-143198315 None] Acquiring lock "cinder-quobyte-41ca395f-15d0-4164-a568-cfe8e2cfc786" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0963910f-0b4a-490d-aae7-b172ed6d4773 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "cinder-quobyte-41ca395f-15d0-4164-a568-cfe8e2cfc786" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0963910f-0b4a-490d-aae7-b172ed6d4773 tempest-VolumesSnapshotListTestJSON-143198315 None] Acquiring lock "cinder-quobyte-f172021c-91a4-4e59-91e4-48fd3bb67904" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0963910f-0b4a-490d-aae7-b172ed6d4773 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "cinder-quobyte-f172021c-91a4-4e59-91e4-48fd3bb67904" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:37 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-0963910f-0b4a-490d-aae7-b172ed6d4773 tempest-VolumesSnapshotListTestJSON-143198315 None] Deleting offline snapshot f172021c-91a4-4e59-91e4-48fd3bb67904 of volume 41ca395f-15d0-4164-a568-cfe8e2cfc786 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:42:37 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-0963910f-0b4a-490d-aae7-b172ed6d4773 tempest-VolumesSnapshotListTestJSON-143198315 None] snapshot_file for this snap is: volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.f172021c-91a4-4e59-91e4-48fd3bb67904 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:42:37 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d65d089-b071-42a2-b85f-ae1cf98f1ec6]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0963910f-0b4a-490d-aae7-b172ed6d4773 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.f172021c-91a4-4e59-91e4-48fd3bb67904 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:37 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5c8d9a24-a421-481a-bdbb-b16a5f22c286 tempest-GroupSnapshotsTest-1443928250 None] Group tempest-GroupSnapshotsTest-Group-2123638152: creating Sep 16 17:42:37 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5c8d9a24-a421-481a-bdbb-b16a5f22c286 tempest-GroupSnapshotsTest-1443928250 None] Group tempest-GroupSnapshotsTest-Group-2123638152: created successfully Sep 16 17:42:37 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5c8d9a24-a421-481a-bdbb-b16a5f22c286 tempest-GroupSnapshotsTest-1443928250 None] Create group completed successfully. Sep 16 17:42:37 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.f172021c-91a4-4e59-91e4-48fd3bb67904 Sep 16 17:42:37 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:38 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0963910f-0b4a-490d-aae7-b172ed6d4773 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.f172021c-91a4-4e59-91e4-48fd3bb67904" returned: 0 in 0.613s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-0963910f-0b4a-490d-aae7-b172ed6d4773 tempest-VolumesSnapshotListTestJSON-143198315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41ca395f-15d0-4164-a568-cfe8e2cfc786(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:42:38 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5a392d-c904-40ec-8a07-a0a0697c4d83]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0963910f-0b4a-490d-aae7-b172ed6d4773 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:38 devstack sudo[94270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 Sep 16 17:42:38 devstack sudo[94270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:38 devstack sudo[94270]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0963910f-0b4a-490d-aae7-b172ed6d4773 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4" returned: 0 in 0.471s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-0963910f-0b4a-490d-aae7-b172ed6d4773 tempest-VolumesSnapshotListTestJSON-143198315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41ca395f-15d0-4164-a568-cfe8e2cfc786(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:42:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0963910f-0b4a-490d-aae7-b172ed6d4773 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.f172021c-91a4-4e59-91e4-48fd3bb67904 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:38 devstack sudo[94275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.f172021c-91a4-4e59-91e4-48fd3bb67904 Sep 16 17:42:38 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:39 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0963910f-0b4a-490d-aae7-b172ed6d4773 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.f172021c-91a4-4e59-91e4-48fd3bb67904" returned: 0 in 0.506s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0963910f-0b4a-490d-aae7-b172ed6d4773 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.f172021c-91a4-4e59-91e4-48fd3bb67904 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:39 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.f172021c-91a4-4e59-91e4-48fd3bb67904 Sep 16 17:42:39 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:39 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0963910f-0b4a-490d-aae7-b172ed6d4773 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.f172021c-91a4-4e59-91e4-48fd3bb67904" returned: 0 in 0.350s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0963910f-0b4a-490d-aae7-b172ed6d4773 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "cinder-quobyte-f172021c-91a4-4e59-91e4-48fd3bb67904" released by "_delete_snapshot" :: held 2.174s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0963910f-0b4a-490d-aae7-b172ed6d4773 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "cinder-quobyte-41ca395f-15d0-4164-a568-cfe8e2cfc786" released by "delete_snapshot" :: held 2.219s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Flow 'volume_create_manager' (75037c80-8ba9-4b7c-a16f-dff874532fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7991819a-a421-4821-999d-ec077a4eba3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7991819a-a421-4821-999d-ec077a4eba3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1406445445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e240af30-92ae-44f3-86be-9ee4d9ec4ad9,host='devstack@QuobyteHD#QuobyteHD',id=a2e0699b-7615-4537-aa36-4026d223d4b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b590ee94887e4a9e8b7c7c5ce1e89747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:42:39Z,use_quota=True,user_id='f9b75a7fd79741e38629fd7ead536847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46f7efb5-6f35-41ea-afba-e2b66f72e126),volume_type_id=46f7efb5-6f35-41ea-afba-e2b66f72e126)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0116be00-52c2-4606-b60c-6fde8cca1827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0116be00-52c2-4606-b60c-6fde8cca1827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8361d2-1932-4a60-a652-d7f3499a662b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8361d2-1932-4a60-a652-d7f3499a662b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2e0699b-7615-4537-aa36-4026d223d4b6', 'volume_name': 'volume-a2e0699b-7615-4537-aa36-4026d223d4b6', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f603ecb-9aad-4617-aee9-2f9f97f892df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f603ecb-9aad-4617-aee9-2f9f97f892df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8abc1b5a-df4c-4db4-a0d5-09c227f35dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:39 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Volume a2e0699b-7615-4537-aa36-4026d223d4b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2e0699b-7615-4537-aa36-4026d223d4b6', 'volume_size': 1} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e240af30-92ae-44f3-86be-9ee4d9ec4ad9,created_at=2026-09-16T15:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1406445445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e240af30-92ae-44f3-86be-9ee4d9ec4ad9,host='devstack@QuobyteHD#QuobyteHD',id=a2e0699b-7615-4537-aa36-4026d223d4b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b590ee94887e4a9e8b7c7c5ce1e89747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:42:39Z,use_quota=True,user_id='f9b75a7fd79741e38629fd7ead536847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46f7efb5-6f35-41ea-afba-e2b66f72e126),volume_type_id=46f7efb5-6f35-41ea-afba-e2b66f72e126)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Creating volume a2e0699b-7615-4537-aa36-4026d223d4b6 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:42:39 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:39 devstack sudo[94285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6 1073741824 Sep 16 17:42:39 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-0963910f-0b4a-490d-aae7-b172ed6d4773 tempest-VolumesSnapshotListTestJSON-143198315 None] Created reservations ['9a7c2a1d-5570-480f-b7d6-7a2a8058bd1e', '0985d90f-f0d7-42e7-98ec-b15a88b801a9', '91a69740-d827-47d0-a4a4-93f6a6650425', '080795e0-7a9c-46c0-aa38-d63e04f5b5bc'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:42:39 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-0963910f-0b4a-490d-aae7-b172ed6d4773 tempest-VolumesSnapshotListTestJSON-143198315 None] Delete snapshot completed successfully. Sep 16 17:42:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0963910f-0b4a-490d-aae7-b172ed6d4773 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "cinder-f172021c-91a4-4e59-91e4-48fd3bb67904-delete_snapshot" released by "delete_snapshot" :: held 2.546s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:40 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6 1073741824" returned: 0 in 0.563s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:40 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6 Sep 16 17:42:40 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:40 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5cef4f70-a2da-473c-807a-d88cf0941375 tempest-VolumesSnapshotListTestJSON-143198315 None] Acquiring lock "cinder-80e28d39-ee1f-44d3-bef3-6bc2baeac5a4-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:40 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6" returned: 0 in 0.447s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:42:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:40 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5cef4f70-a2da-473c-807a-d88cf0941375 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "cinder-80e28d39-ee1f-44d3-bef3-6bc2baeac5a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:40 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5cef4f70-a2da-473c-807a-d88cf0941375 tempest-VolumesSnapshotListTestJSON-143198315 None] Acquiring lock "cinder-quobyte-41ca395f-15d0-4164-a568-cfe8e2cfc786" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8abc1b5a-df4c-4db4-a0d5-09c227f35dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2e0699b-7615-4537-aa36-4026d223d4b6', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (344166b7-b243-4d98-aa76-93668d102b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:42:40 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5cef4f70-a2da-473c-807a-d88cf0941375 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "cinder-quobyte-41ca395f-15d0-4164-a568-cfe8e2cfc786" acquired by "delete_snapshot" :: waited 0.096s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:40 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5cef4f70-a2da-473c-807a-d88cf0941375 tempest-VolumesSnapshotListTestJSON-143198315 None] Acquiring lock "cinder-quobyte-80e28d39-ee1f-44d3-bef3-6bc2baeac5a4" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:40 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Volume volume-a2e0699b-7615-4537-aa36-4026d223d4b6 (a2e0699b-7615-4537-aa36-4026d223d4b6): created successfully Sep 16 17:42:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (344166b7-b243-4d98-aa76-93668d102b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:42:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Flow 'volume_create_manager' (75037c80-8ba9-4b7c-a16f-dff874532fe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:42:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5cef4f70-a2da-473c-807a-d88cf0941375 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "cinder-quobyte-80e28d39-ee1f-44d3-bef3-6bc2baeac5a4" acquired by "_delete_snapshot" :: waited 0.137s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:41 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5cef4f70-a2da-473c-807a-d88cf0941375 tempest-VolumesSnapshotListTestJSON-143198315 None] Deleting offline snapshot 80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 of volume 41ca395f-15d0-4164-a568-cfe8e2cfc786 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:42:41 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5cef4f70-a2da-473c-807a-d88cf0941375 tempest-VolumesSnapshotListTestJSON-143198315 None] snapshot_file for this snap is: volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:42:41 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-69d8abba-8329-4fb8-ab51-ba80d0bb3c9c tempest-GroupSnapshotsTest-1443928250 None] Created volume successfully. Sep 16 17:42:41 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8a0f47-3386-419f-bf24-37b663f0f25e]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5cef4f70-a2da-473c-807a-d88cf0941375 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:41 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 Sep 16 17:42:41 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:41 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5cef4f70-a2da-473c-807a-d88cf0941375 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4" returned: 0 in 0.562s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:41 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5cef4f70-a2da-473c-807a-d88cf0941375 tempest-VolumesSnapshotListTestJSON-143198315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41ca395f-15d0-4164-a568-cfe8e2cfc786(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:42:41 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0930423a-47d3-46ef-866a-bd24d181f3de]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5cef4f70-a2da-473c-807a-d88cf0941375 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:41 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3 Sep 16 17:42:41 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:42 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5cef4f70-a2da-473c-807a-d88cf0941375 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3" returned: 0 in 0.587s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5cef4f70-a2da-473c-807a-d88cf0941375 tempest-VolumesSnapshotListTestJSON-143198315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41ca395f-15d0-4164-a568-cfe8e2cfc786(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:42:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5cef4f70-a2da-473c-807a-d88cf0941375 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:42 devstack sudo[94377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 Sep 16 17:42:42 devstack sudo[94377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:42 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-26aabbee-7816-45b4-9216-e7a140f9a782 tempest-GroupSnapshotsTest-1443928250 None] GroupSnapshot 89c8a65c-4bbc-4877-827d-6b60234dca91: creating. Sep 16 17:42:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-26aabbee-7816-45b4-9216-e7a140f9a782 tempest-GroupSnapshotsTest-1443928250 None] Group snapshot 89c8a65c-4bbc-4877-827d-6b60234dca91: creating. {{(pid=85899) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4171}} Sep 16 17:42:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-26aabbee-7816-45b4-9216-e7a140f9a782 tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-26aabbee-7816-45b4-9216-e7a140f9a782 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-26aabbee-7816-45b4-9216-e7a140f9a782 tempest-GroupSnapshotsTest-1443928250 None] Creating offline snapshot 1c445182-9f78-4dde-8c5c-aa28fb0a221a of volume a2e0699b-7615-4537-aa36-4026d223d4b6 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:42:42 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7a7cf2-05bc-4512-b147-879b3a1ec600]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-26aabbee-7816-45b4-9216-e7a140f9a782 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:43 devstack sudo[94377]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5cef4f70-a2da-473c-807a-d88cf0941375 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4" returned: 0 in 0.657s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5cef4f70-a2da-473c-807a-d88cf0941375 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:43 devstack sudo[94382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6 Sep 16 17:42:43 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:43 devstack sudo[94383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4 Sep 16 17:42:43 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:43 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5cef4f70-a2da-473c-807a-d88cf0941375 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.80e28d39-ee1f-44d3-bef3-6bc2baeac5a4" returned: 0 in 0.390s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5cef4f70-a2da-473c-807a-d88cf0941375 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "cinder-quobyte-80e28d39-ee1f-44d3-bef3-6bc2baeac5a4" released by "_delete_snapshot" :: held 2.440s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5cef4f70-a2da-473c-807a-d88cf0941375 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "cinder-quobyte-41ca395f-15d0-4164-a568-cfe8e2cfc786" released by "delete_snapshot" :: held 2.604s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:43 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-26aabbee-7816-45b4-9216-e7a140f9a782 tempest-GroupSnapshotsTest-1443928250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6" returned: 0 in 0.661s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-26aabbee-7816-45b4-9216-e7a140f9a782 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.1c445182-9f78-4dde-8c5c-aa28fb0a221a 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:43 devstack sudo[94396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.1c445182-9f78-4dde-8c5c-aa28fb0a221a 1G Sep 16 17:42:43 devstack sudo[94396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:43 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-5cef4f70-a2da-473c-807a-d88cf0941375 tempest-VolumesSnapshotListTestJSON-143198315 None] Created reservations ['3dcccda7-0c08-461c-8849-ff620ef580f1', '48ace750-f311-4bcb-bba5-aba7d91b42f4', 'f17229c2-b90a-4c7d-b931-776d09cf7640', '5d9f7fa7-6c13-41c1-afac-c017c45c284e'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:42:43 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5cef4f70-a2da-473c-807a-d88cf0941375 tempest-VolumesSnapshotListTestJSON-143198315 None] Delete snapshot completed successfully. Sep 16 17:42:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5cef4f70-a2da-473c-807a-d88cf0941375 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "cinder-80e28d39-ee1f-44d3-bef3-6bc2baeac5a4-delete_snapshot" released by "delete_snapshot" :: held 2.975s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-208ea709-8980-4dc5-ba15-c8e91851a9d8 tempest-VolumesSnapshotListTestJSON-143198315 None] Acquiring lock "cinder-0c7d9e37-f97e-4945-adc9-a825874529d3-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-208ea709-8980-4dc5-ba15-c8e91851a9d8 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "cinder-0c7d9e37-f97e-4945-adc9-a825874529d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-208ea709-8980-4dc5-ba15-c8e91851a9d8 tempest-VolumesSnapshotListTestJSON-143198315 None] Acquiring lock "cinder-quobyte-41ca395f-15d0-4164-a568-cfe8e2cfc786" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-208ea709-8980-4dc5-ba15-c8e91851a9d8 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "cinder-quobyte-41ca395f-15d0-4164-a568-cfe8e2cfc786" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-208ea709-8980-4dc5-ba15-c8e91851a9d8 tempest-VolumesSnapshotListTestJSON-143198315 None] Acquiring lock "cinder-quobyte-0c7d9e37-f97e-4945-adc9-a825874529d3" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-208ea709-8980-4dc5-ba15-c8e91851a9d8 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "cinder-quobyte-0c7d9e37-f97e-4945-adc9-a825874529d3" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-208ea709-8980-4dc5-ba15-c8e91851a9d8 tempest-VolumesSnapshotListTestJSON-143198315 None] Deleting offline snapshot 0c7d9e37-f97e-4945-adc9-a825874529d3 of volume 41ca395f-15d0-4164-a568-cfe8e2cfc786 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:42:44 devstack sudo[94396]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-208ea709-8980-4dc5-ba15-c8e91851a9d8 tempest-VolumesSnapshotListTestJSON-143198315 None] snapshot_file for this snap is: volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:42:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-26aabbee-7816-45b4-9216-e7a140f9a782 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.1c445182-9f78-4dde-8c5c-aa28fb0a221a 1G" returned: 0 in 0.625s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-26aabbee-7816-45b4-9216-e7a140f9a782 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e0699b-7615-4537-aa36-4026d223d4b6 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.1c445182-9f78-4dde-8c5c-aa28fb0a221a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:44 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f44e046-c282-4151-bccd-fdaccd0a6b43]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-208ea709-8980-4dc5-ba15-c8e91851a9d8 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:44 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e0699b-7615-4537-aa36-4026d223d4b6 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.1c445182-9f78-4dde-8c5c-aa28fb0a221a Sep 16 17:42:44 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:44 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3 Sep 16 17:42:44 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:44 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:44 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-26aabbee-7816-45b4-9216-e7a140f9a782 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e0699b-7615-4537-aa36-4026d223d4b6 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.1c445182-9f78-4dde-8c5c-aa28fb0a221a" returned: 0 in 0.514s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-208ea709-8980-4dc5-ba15-c8e91851a9d8 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3" returned: 0 in 0.497s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:44 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-26aabbee-7816-45b4-9216-e7a140f9a782 tempest-GroupSnapshotsTest-1443928250 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.1c445182-9f78-4dde-8c5c-aa28fb0a221a is being set with open permissions: ugo+rw: NotImplementedError Sep 16 17:42:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-26aabbee-7816-45b4-9216-e7a140f9a782 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.1c445182-9f78-4dde-8c5c-aa28fb0a221a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-208ea709-8980-4dc5-ba15-c8e91851a9d8 tempest-VolumesSnapshotListTestJSON-143198315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41ca395f-15d0-4164-a568-cfe8e2cfc786(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:42:44 devstack sudo[94413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.1c445182-9f78-4dde-8c5c-aa28fb0a221a Sep 16 17:42:44 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5c3b988a-b0e6-4feb-bf66-2d1beab331db tempest-VolumesActionsTest-1412284646 None] Acquiring lock "cinder-2109ac70-7ac7-4588-a7e9-5ecddd478aa5" by "attach_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:44 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced84e97-1068-4dd7-a07a-0cf1b343913e]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-208ea709-8980-4dc5-ba15-c8e91851a9d8 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5c3b988a-b0e6-4feb-bf66-2d1beab331db tempest-VolumesActionsTest-1412284646 None] Lock "cinder-2109ac70-7ac7-4588-a7e9-5ecddd478aa5" acquired by "attach_volume" :: waited 0.064s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:44 devstack sudo[94415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786 Sep 16 17:42:44 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:44 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5c3b988a-b0e6-4feb-bf66-2d1beab331db tempest-VolumesActionsTest-1412284646 None] Attaching volume 2109ac70-7ac7-4588-a7e9-5ecddd478aa5 to instance 31b4e80e-c97e-4a9a-8ccd-c7d87ac1479a at mountpoint /dev/vdb on host None. Sep 16 17:42:44 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5c3b988a-b0e6-4feb-bf66-2d1beab331db tempest-VolumesActionsTest-1412284646 None] Attach volume completed successfully. Sep 16 17:42:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5c3b988a-b0e6-4feb-bf66-2d1beab331db tempest-VolumesActionsTest-1412284646 None] Lock "cinder-2109ac70-7ac7-4588-a7e9-5ecddd478aa5" released by "attach_volume" :: held 0.220s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:45 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-26aabbee-7816-45b4-9216-e7a140f9a782 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.1c445182-9f78-4dde-8c5c-aa28fb0a221a" returned: 0 in 0.454s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-26aabbee-7816-45b4-9216-e7a140f9a782 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:45 devstack sudo[94418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.info Sep 16 17:42:45 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d7310e70-129b-4045-a432-a6a53e866a1d tempest-VolumesActionsTest-1412284646 None] Acquiring lock "cinder-2109ac70-7ac7-4588-a7e9-5ecddd478aa5-detach_volume" by "detach_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d7310e70-129b-4045-a432-a6a53e866a1d tempest-VolumesActionsTest-1412284646 None] Lock "cinder-2109ac70-7ac7-4588-a7e9-5ecddd478aa5-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:45 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-d7310e70-129b-4045-a432-a6a53e866a1d tempest-VolumesActionsTest-1412284646 None] Detaching volume 2109ac70-7ac7-4588-a7e9-5ecddd478aa5 from instance 31b4e80e-c97e-4a9a-8ccd-c7d87ac1479a. Sep 16 17:42:45 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-208ea709-8980-4dc5-ba15-c8e91851a9d8 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786" returned: 0 in 0.630s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-208ea709-8980-4dc5-ba15-c8e91851a9d8 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:45 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-d7310e70-129b-4045-a432-a6a53e866a1d tempest-VolumesActionsTest-1412284646 None] Detach volume completed successfully. Sep 16 17:42:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d7310e70-129b-4045-a432-a6a53e866a1d tempest-VolumesActionsTest-1412284646 None] Lock "cinder-2109ac70-7ac7-4588-a7e9-5ecddd478aa5-detach_volume" released by "detach_volume" :: held 0.115s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:45 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3 Sep 16 17:42:45 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:45 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-26aabbee-7816-45b4-9216-e7a140f9a782 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.info" returned: 0 in 0.488s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:45 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-26aabbee-7816-45b4-9216-e7a140f9a782 tempest-GroupSnapshotsTest-1443928250 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.info is being set with open permissions: ugo+rw: NotImplementedError Sep 16 17:42:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-26aabbee-7816-45b4-9216-e7a140f9a782 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:45 devstack sudo[94426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.info Sep 16 17:42:45 devstack sudo[94426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:46 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-208ea709-8980-4dc5-ba15-c8e91851a9d8 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3" returned: 0 in 0.716s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-208ea709-8980-4dc5-ba15-c8e91851a9d8 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:46 devstack sudo[94426]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-26aabbee-7816-45b4-9216-e7a140f9a782 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.info" returned: 0 in 0.469s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:46 devstack sudo[94434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3 Sep 16 17:42:46 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-26aabbee-7816-45b4-9216-e7a140f9a782 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.391s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:46 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-26aabbee-7816-45b4-9216-e7a140f9a782 tempest-GroupSnapshotsTest-1443928250 None] group_snapshot 89c8a65c-4bbc-4877-827d-6b60234dca91: created successfully Sep 16 17:42:46 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-208ea709-8980-4dc5-ba15-c8e91851a9d8 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786.0c7d9e37-f97e-4945-adc9-a825874529d3" returned: 0 in 0.466s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-208ea709-8980-4dc5-ba15-c8e91851a9d8 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "cinder-quobyte-0c7d9e37-f97e-4945-adc9-a825874529d3" released by "_delete_snapshot" :: held 2.514s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-208ea709-8980-4dc5-ba15-c8e91851a9d8 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "cinder-quobyte-41ca395f-15d0-4164-a568-cfe8e2cfc786" released by "delete_snapshot" :: held 2.556s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:46 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-208ea709-8980-4dc5-ba15-c8e91851a9d8 tempest-VolumesSnapshotListTestJSON-143198315 None] Created reservations ['da9ecf8b-59be-413f-826f-d018e3278e7a', 'e95f84ae-c5c0-4d49-83f1-b4af7fa2a6db', '34b174d5-07b7-4c84-b0b6-4e79c92b2771', '26906f1b-53a1-4df3-8287-7290f0a84bef'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:42:46 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-208ea709-8980-4dc5-ba15-c8e91851a9d8 tempest-VolumesSnapshotListTestJSON-143198315 None] Delete snapshot completed successfully. Sep 16 17:42:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-208ea709-8980-4dc5-ba15-c8e91851a9d8 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "cinder-0c7d9e37-f97e-4945-adc9-a825874529d3-delete_snapshot" released by "delete_snapshot" :: held 2.731s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:47 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0854c17c-2536-4d5e-9e4d-05bde2f9c543 tempest-VolumesSnapshotListTestJSON-143198315 None] Acquiring lock "cinder-41ca395f-15d0-4164-a568-cfe8e2cfc786-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:47 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0854c17c-2536-4d5e-9e4d-05bde2f9c543 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "cinder-41ca395f-15d0-4164-a568-cfe8e2cfc786-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:47 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0854c17c-2536-4d5e-9e4d-05bde2f9c543 tempest-VolumesSnapshotListTestJSON-143198315 None] Acquiring lock "cinder-quobyte-41ca395f-15d0-4164-a568-cfe8e2cfc786" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:47 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0854c17c-2536-4d5e-9e4d-05bde2f9c543 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "cinder-quobyte-41ca395f-15d0-4164-a568-cfe8e2cfc786" acquired by "delete_volume" :: waited 0.046s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:47 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa38ac2-42db-45c5-8ab8-e4f283443180]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0854c17c-2536-4d5e-9e4d-05bde2f9c543 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:47 devstack sudo[94460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786 Sep 16 17:42:47 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:47 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "cinder-quobyte-1c445182-9f78-4dde-8c5c-aa28fb0a221a-e384e0d8-f429-4709-b589-51d76ddc3b54" by "_create_volume_from_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:47 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-1c445182-9f78-4dde-8c5c-aa28fb0a221a-e384e0d8-f429-4709-b589-51d76ddc3b54" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Creating volume e384e0d8-f429-4709-b589-51d76ddc3b54 from snapshot 1c445182-9f78-4dde-8c5c-aa28fb0a221a {{(pid=85899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 17:42:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:42:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:42:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:42:47 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "cinder-quobyte-e384e0d8-f429-4709-b589-51d76ddc3b54" by "_copy_volume_from_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-e384e0d8-f429-4709-b589-51d76ddc3b54" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] snapshot: 1c445182-9f78-4dde-8c5c-aa28fb0a221a, volume: e384e0d8-f429-4709-b589-51d76ddc3b54, {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c12829-d89c-4c50-9a06-f2bd3ab935ae]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.1c445182-9f78-4dde-8c5c-aa28fb0a221a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:48 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0854c17c-2536-4d5e-9e4d-05bde2f9c543 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786" returned: 0 in 0.639s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0854c17c-2536-4d5e-9e4d-05bde2f9c543 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:48 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.1c445182-9f78-4dde-8c5c-aa28fb0a221a Sep 16 17:42:48 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:48 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786 Sep 16 17:42:48 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:48 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.1c445182-9f78-4dde-8c5c-aa28fb0a221a" returned: 0 in 0.533s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2e0699b-7615-4537-aa36-4026d223d4b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90dcf80-d209-4009-aefd-124d0e8ba38b]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:48 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0854c17c-2536-4d5e-9e4d-05bde2f9c543 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca395f-15d0-4164-a568-cfe8e2cfc786" returned: 0 in 0.400s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0854c17c-2536-4d5e-9e4d-05bde2f9c543 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "cinder-quobyte-41ca395f-15d0-4164-a568-cfe8e2cfc786" released by "delete_volume" :: held 1.141s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:48 devstack sudo[94474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6 Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-0854c17c-2536-4d5e-9e4d-05bde2f9c543 tempest-VolumesSnapshotListTestJSON-143198315 None] Created reservations ['625a9c9d-c96a-48ca-9d96-7860cb66e8b7', 'db45e8dc-a740-4ee4-8297-ba5d52c16d4f', 'be6dd90c-14fc-4d2a-8ab9-ee17d7e272b3', '71d7b4f9-fd94-4180-9880-400ad97fb0b6'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:42:48 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0854c17c-2536-4d5e-9e4d-05bde2f9c543 tempest-VolumesSnapshotListTestJSON-143198315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0854c17c-2536-4d5e-9e4d-05bde2f9c543 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0854c17c-2536-4d5e-9e4d-05bde2f9c543 tempest-VolumesSnapshotListTestJSON-143198315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0854c17c-2536-4d5e-9e4d-05bde2f9c543 tempest-VolumesSnapshotListTestJSON-143198315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0854c17c-2536-4d5e-9e4d-05bde2f9c543 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0854c17c-2536-4d5e-9e4d-05bde2f9c543 tempest-VolumesSnapshotListTestJSON-143198315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:48 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:42:48 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:49 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6" returned: 0 in 0.429s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6 {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 17:42:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Creating direct copy from snapshot {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 17:42:49 devstack cinder-volume[85899]: DEBUG cinder.utils [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Path /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e384e0d8-f429-4709-b589-51d76ddc3b54 not found in is_blk_device check {{(pid=85899) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 17:42:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e384e0d8-f429-4709-b589-51d76ddc3b54 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:49 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e384e0d8-f429-4709-b589-51d76ddc3b54 Sep 16 17:42:49 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:49 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0854c17c-2536-4d5e-9e4d-05bde2f9c543 tempest-VolumesSnapshotListTestJSON-143198315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.310s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:49 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-0854c17c-2536-4d5e-9e4d-05bde2f9c543 tempest-VolumesSnapshotListTestJSON-143198315 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:42:49 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-0854c17c-2536-4d5e-9e4d-05bde2f9c543 tempest-VolumesSnapshotListTestJSON-143198315 None] Deleted volume successfully. Sep 16 17:42:49 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0854c17c-2536-4d5e-9e4d-05bde2f9c543 tempest-VolumesSnapshotListTestJSON-143198315 None] Lock "cinder-41ca395f-15d0-4164-a568-cfe8e2cfc786-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:58 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=48,cinder:UPDATE=47,cinder:INSERT=11,cinder:DELETE=1 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:42:59 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e384e0d8-f429-4709-b589-51d76ddc3b54" returned: 0 in 9.956s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:59 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Image conversion details: src /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6, size 1024.00 MB, duration 9.96 sec, destination /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e384e0d8-f429-4709-b589-51d76ddc3b54 {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:42:59 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Converted 1024.00 MB image at 102.84 MB/s Sep 16 17:42:59 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e384e0d8-f429-4709-b589-51d76ddc3b54 is being set with open permissions: ugo+rw: NotImplementedError Sep 16 17:42:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e384e0d8-f429-4709-b589-51d76ddc3b54 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:42:59 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e384e0d8-f429-4709-b589-51d76ddc3b54 Sep 16 17:42:59 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:42:59 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=57,cinder:INSERT=20,cinder:UPDATE=56,cinder:DELETE=6 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:42:59 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Sep 16 17:42:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e384e0d8-f429-4709-b589-51d76ddc3b54" returned: 0 in 0.268s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:42:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-e384e0d8-f429-4709-b589-51d76ddc3b54" released by "_copy_volume_from_snapshot" :: held 11.349s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-1c445182-9f78-4dde-8c5c-aa28fb0a221a-e384e0d8-f429-4709-b589-51d76ddc3b54" released by "_create_volume_from_snapshot" :: held 11.483s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:42:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.520s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:42:59 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-0aa4c338-1cc4-4f68-a1b3-df7d667f8e01 tempest-GroupSnapshotsTest-1443928250 None] Create group from source-snapshot-89c8a65c-4bbc-4877-827d-6b60234dca91 completed successfully. Sep 16 17:43:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-111d1ed3-1331-41e2-a901-53eefb6f9b1d tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "cinder-quobyte-e384e0d8-f429-4709-b589-51d76ddc3b54" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:43:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-111d1ed3-1331-41e2-a901-53eefb6f9b1d tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-e384e0d8-f429-4709-b589-51d76ddc3b54" acquired by "delete_volume" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:43:00 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe56727-b814-46e3-94b2-a021e64ef8a4]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:43:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-111d1ed3-1331-41e2-a901-53eefb6f9b1d tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e384e0d8-f429-4709-b589-51d76ddc3b54 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:00 devstack sudo[94520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e384e0d8-f429-4709-b589-51d76ddc3b54 Sep 16 17:43:00 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:00 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-111d1ed3-1331-41e2-a901-53eefb6f9b1d tempest-GroupSnapshotsTest-1443928250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e384e0d8-f429-4709-b589-51d76ddc3b54" returned: 0 in 0.442s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-111d1ed3-1331-41e2-a901-53eefb6f9b1d tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e384e0d8-f429-4709-b589-51d76ddc3b54 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:00 devstack sudo[94526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e384e0d8-f429-4709-b589-51d76ddc3b54 Sep 16 17:43:00 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:00 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-111d1ed3-1331-41e2-a901-53eefb6f9b1d tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e384e0d8-f429-4709-b589-51d76ddc3b54" returned: 0 in 0.279s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-111d1ed3-1331-41e2-a901-53eefb6f9b1d tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-e384e0d8-f429-4709-b589-51d76ddc3b54" released by "delete_volume" :: held 0.797s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:43:01 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-111d1ed3-1331-41e2-a901-53eefb6f9b1d tempest-GroupSnapshotsTest-1443928250 None] Created reservations ['d0ea2295-d2c3-4457-9e2d-22614100162a'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:43:01 devstack cinder-volume[85899]: WARNING cinder.quota [None req-111d1ed3-1331-41e2-a901-53eefb6f9b1d tempest-GroupSnapshotsTest-1443928250 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-409866238 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-409866238, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:43:01 devstack cinder-volume[85899]: WARNING cinder.quota [None req-111d1ed3-1331-41e2-a901-53eefb6f9b1d tempest-GroupSnapshotsTest-1443928250 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-409866238 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-409866238, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:43:01 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-111d1ed3-1331-41e2-a901-53eefb6f9b1d tempest-GroupSnapshotsTest-1443928250 None] Created reservations ['3ea55725-199b-46ab-a5bc-933dc665513f', '7cdfd6d4-85a8-4c89-b39d-c5d0ad4af383', 'c0d8656b-61dc-449b-a459-8a855264f443', 'f89473be-ba38-4142-bced-ef945505cf33'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:43:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-111d1ed3-1331-41e2-a901-53eefb6f9b1d tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:43:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-111d1ed3-1331-41e2-a901-53eefb6f9b1d tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:43:01 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-111d1ed3-1331-41e2-a901-53eefb6f9b1d tempest-GroupSnapshotsTest-1443928250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:43:01 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-111d1ed3-1331-41e2-a901-53eefb6f9b1d tempest-GroupSnapshotsTest-1443928250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:43:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-111d1ed3-1331-41e2-a901-53eefb6f9b1d tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:43:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-111d1ed3-1331-41e2-a901-53eefb6f9b1d tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:01 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:43:01 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:01 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-bc5d5ddc-c1fa-4c9a-9a05-0ff8b3b069b9 tempest-GroupSnapshotsTest-1443928250 None] group_snapshot 89c8a65c-4bbc-4877-827d-6b60234dca91: deleting Sep 16 17:43:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bc5d5ddc-c1fa-4c9a-9a05-0ff8b3b069b9 tempest-GroupSnapshotsTest-1443928250 None] group_snapshot 89c8a65c-4bbc-4877-827d-6b60234dca91: deleting {{(pid=85899) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4346}} Sep 16 17:43:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bc5d5ddc-c1fa-4c9a-9a05-0ff8b3b069b9 tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "cinder-quobyte-a2e0699b-7615-4537-aa36-4026d223d4b6" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:43:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bc5d5ddc-c1fa-4c9a-9a05-0ff8b3b069b9 tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-a2e0699b-7615-4537-aa36-4026d223d4b6" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:43:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bc5d5ddc-c1fa-4c9a-9a05-0ff8b3b069b9 tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "cinder-quobyte-1c445182-9f78-4dde-8c5c-aa28fb0a221a" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:43:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bc5d5ddc-c1fa-4c9a-9a05-0ff8b3b069b9 tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-1c445182-9f78-4dde-8c5c-aa28fb0a221a" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:43:01 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-bc5d5ddc-c1fa-4c9a-9a05-0ff8b3b069b9 tempest-GroupSnapshotsTest-1443928250 None] Deleting offline snapshot 1c445182-9f78-4dde-8c5c-aa28fb0a221a of volume a2e0699b-7615-4537-aa36-4026d223d4b6 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:43:01 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-bc5d5ddc-c1fa-4c9a-9a05-0ff8b3b069b9 tempest-GroupSnapshotsTest-1443928250 None] snapshot_file for this snap is: volume-a2e0699b-7615-4537-aa36-4026d223d4b6.1c445182-9f78-4dde-8c5c-aa28fb0a221a {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:43:01 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f920491a-7274-484c-a9ca-9beaaef5c4a1]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:43:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bc5d5ddc-c1fa-4c9a-9a05-0ff8b3b069b9 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.1c445182-9f78-4dde-8c5c-aa28fb0a221a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:01 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-111d1ed3-1331-41e2-a901-53eefb6f9b1d tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.519s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:01 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-111d1ed3-1331-41e2-a901-53eefb6f9b1d tempest-GroupSnapshotsTest-1443928250 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:43:01 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-111d1ed3-1331-41e2-a901-53eefb6f9b1d tempest-GroupSnapshotsTest-1443928250 None] Delete group completed successfully. Sep 16 17:43:01 devstack sudo[94533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.1c445182-9f78-4dde-8c5c-aa28fb0a221a Sep 16 17:43:01 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:02 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bc5d5ddc-c1fa-4c9a-9a05-0ff8b3b069b9 tempest-GroupSnapshotsTest-1443928250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.1c445182-9f78-4dde-8c5c-aa28fb0a221a" returned: 0 in 0.481s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-bc5d5ddc-c1fa-4c9a-9a05-0ff8b3b069b9 tempest-GroupSnapshotsTest-1443928250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2e0699b-7615-4537-aa36-4026d223d4b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:43:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:43:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:43:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:43:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:43:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:43:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:43:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:02 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44287a9-7d6b-4663-a489-d838d40e8c03]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:43:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bc5d5ddc-c1fa-4c9a-9a05-0ff8b3b069b9 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:02 devstack sudo[94539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:43:02 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:02 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6 Sep 16 17:43:02 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:02 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.315s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:43:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager._thread_info {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:43:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread count: 28 {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:43:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread info: [<_MainThread(MainThread, started 123748124422272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:43:02 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bc5d5ddc-c1fa-4c9a-9a05-0ff8b3b069b9 tempest-GroupSnapshotsTest-1443928250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6" returned: 0 in 0.731s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bc5d5ddc-c1fa-4c9a-9a05-0ff8b3b069b9 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.1c445182-9f78-4dde-8c5c-aa28fb0a221a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:03 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.1c445182-9f78-4dde-8c5c-aa28fb0a221a Sep 16 17:43:03 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:03 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bc5d5ddc-c1fa-4c9a-9a05-0ff8b3b069b9 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.1c445182-9f78-4dde-8c5c-aa28fb0a221a" returned: 0 in 0.512s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bc5d5ddc-c1fa-4c9a-9a05-0ff8b3b069b9 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.1c445182-9f78-4dde-8c5c-aa28fb0a221a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:03 devstack sudo[94553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.1c445182-9f78-4dde-8c5c-aa28fb0a221a Sep 16 17:43:03 devstack sudo[94553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:04 devstack sudo[94553]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bc5d5ddc-c1fa-4c9a-9a05-0ff8b3b069b9 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6.1c445182-9f78-4dde-8c5c-aa28fb0a221a" returned: 0 in 0.660s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:04 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bc5d5ddc-c1fa-4c9a-9a05-0ff8b3b069b9 tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-1c445182-9f78-4dde-8c5c-aa28fb0a221a" released by "_delete_snapshot" :: held 2.576s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:43:04 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bc5d5ddc-c1fa-4c9a-9a05-0ff8b3b069b9 tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-a2e0699b-7615-4537-aa36-4026d223d4b6" released by "delete_snapshot" :: held 2.637s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:43:04 devstack cinder-volume[85899]: WARNING cinder.quota [None req-bc5d5ddc-c1fa-4c9a-9a05-0ff8b3b069b9 tempest-GroupSnapshotsTest-1443928250 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-409866238 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-409866238, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:43:04 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-bc5d5ddc-c1fa-4c9a-9a05-0ff8b3b069b9 tempest-GroupSnapshotsTest-1443928250 None] Created reservations ['ffd75d85-665b-4c67-8ff3-a7ffd1ba4ad1', '2c7f9eb1-23b2-4ea5-a2a5-a38f97b9ae70', 'd4da620a-efa5-48b3-9dfb-d2b659457d47', '8fe459cf-b07f-424a-a114-9b499a41d272'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:43:04 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-bc5d5ddc-c1fa-4c9a-9a05-0ff8b3b069b9 tempest-GroupSnapshotsTest-1443928250 None] group_snapshot 89c8a65c-4bbc-4877-827d-6b60234dca91: deleted successfully Sep 16 17:43:05 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b667d767-3593-4103-be15-9238e8ee91db tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "cinder-quobyte-a2e0699b-7615-4537-aa36-4026d223d4b6" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:43:05 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b667d767-3593-4103-be15-9238e8ee91db tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-a2e0699b-7615-4537-aa36-4026d223d4b6" acquired by "delete_volume" :: waited 0.031s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:43:05 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[df63d904-01c2-4234-ac48-8c91f60c00f0]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:43:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b667d767-3593-4103-be15-9238e8ee91db tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:06 devstack sudo[94623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6 Sep 16 17:43:06 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:06 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b667d767-3593-4103-be15-9238e8ee91db tempest-GroupSnapshotsTest-1443928250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6" returned: 0 in 0.852s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b667d767-3593-4103-be15-9238e8ee91db tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:06 devstack sudo[94633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6 Sep 16 17:43:06 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:07 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b667d767-3593-4103-be15-9238e8ee91db tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a2e0699b-7615-4537-aa36-4026d223d4b6" returned: 0 in 0.430s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:07 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b667d767-3593-4103-be15-9238e8ee91db tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-a2e0699b-7615-4537-aa36-4026d223d4b6" released by "delete_volume" :: held 1.440s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:43:07 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-b667d767-3593-4103-be15-9238e8ee91db tempest-GroupSnapshotsTest-1443928250 None] Created reservations ['b8c11c99-c303-4e2b-846b-1ea840167ec2'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:43:07 devstack cinder-volume[85899]: WARNING cinder.db.api [None req-b667d767-3593-4103-be15-9238e8ee91db tempest-GroupSnapshotsTest-1443928250 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-409866238'] Sep 16 17:43:07 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-b667d767-3593-4103-be15-9238e8ee91db tempest-GroupSnapshotsTest-1443928250 None] Created reservations ['f97fae4b-1991-4c67-bc74-febaae2571a0', '178866d1-5afa-434a-b8ea-fccfde001a75', '7358b2e4-62ae-4a38-bf17-eb5108495420', '05e8d633-9442-42b6-8ff3-21c304f535ac'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:43:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b667d767-3593-4103-be15-9238e8ee91db tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:43:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b667d767-3593-4103-be15-9238e8ee91db tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:43:07 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b667d767-3593-4103-be15-9238e8ee91db tempest-GroupSnapshotsTest-1443928250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:43:07 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b667d767-3593-4103-be15-9238e8ee91db tempest-GroupSnapshotsTest-1443928250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:43:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b667d767-3593-4103-be15-9238e8ee91db tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:43:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b667d767-3593-4103-be15-9238e8ee91db tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:07 devstack sudo[94636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:43:07 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:07 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b667d767-3593-4103-be15-9238e8ee91db tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.338s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:07 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b667d767-3593-4103-be15-9238e8ee91db tempest-GroupSnapshotsTest-1443928250 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:43:07 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-b667d767-3593-4103-be15-9238e8ee91db tempest-GroupSnapshotsTest-1443928250 None] Delete group completed successfully. Sep 16 17:43:09 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-0ec6e75b-e271-4c08-a64a-ca9b8d4d2824 tempest-GroupSnapshotsTest-1443928250 None] Group tempest-GroupSnapshotsTest-Group-1833274689: creating Sep 16 17:43:09 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-0ec6e75b-e271-4c08-a64a-ca9b8d4d2824 tempest-GroupSnapshotsTest-1443928250 None] Group tempest-GroupSnapshotsTest-Group-1833274689: created successfully Sep 16 17:43:09 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-0ec6e75b-e271-4c08-a64a-ca9b8d4d2824 tempest-GroupSnapshotsTest-1443928250 None] Create group completed successfully. Sep 16 17:43:09 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2e7b500c-4dc6-487e-9070-ee76da1c4c9e tempest-VolumesActionsTest-1412284646 None] Acquiring lock "cinder-2109ac70-7ac7-4588-a7e9-5ecddd478aa5" by "attach_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:43:09 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2e7b500c-4dc6-487e-9070-ee76da1c4c9e tempest-VolumesActionsTest-1412284646 None] Lock "cinder-2109ac70-7ac7-4588-a7e9-5ecddd478aa5" acquired by "attach_volume" :: waited 0.034s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:43:09 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-2e7b500c-4dc6-487e-9070-ee76da1c4c9e tempest-VolumesActionsTest-1412284646 None] Attaching volume 2109ac70-7ac7-4588-a7e9-5ecddd478aa5 to instance f78a078f-3d36-454c-9cb7-45c1ee99cb4a at mountpoint /dev/vdb on host None. Sep 16 17:43:09 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-2e7b500c-4dc6-487e-9070-ee76da1c4c9e tempest-VolumesActionsTest-1412284646 None] Attach volume completed successfully. Sep 16 17:43:09 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2e7b500c-4dc6-487e-9070-ee76da1c4c9e tempest-VolumesActionsTest-1412284646 None] Lock "cinder-2109ac70-7ac7-4588-a7e9-5ecddd478aa5" released by "attach_volume" :: held 0.132s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:43:09 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d5f4edf2-1885-43b7-b794-82dce639e32a tempest-VolumesActionsTest-1412284646 None] Acquiring lock "cinder-2109ac70-7ac7-4588-a7e9-5ecddd478aa5-detach_volume" by "detach_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:43:09 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d5f4edf2-1885-43b7-b794-82dce639e32a tempest-VolumesActionsTest-1412284646 None] Lock "cinder-2109ac70-7ac7-4588-a7e9-5ecddd478aa5-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:43:09 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-d5f4edf2-1885-43b7-b794-82dce639e32a tempest-VolumesActionsTest-1412284646 None] Detaching volume 2109ac70-7ac7-4588-a7e9-5ecddd478aa5 from instance f78a078f-3d36-454c-9cb7-45c1ee99cb4a. Sep 16 17:43:10 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-d5f4edf2-1885-43b7-b794-82dce639e32a tempest-VolumesActionsTest-1412284646 None] Detach volume completed successfully. Sep 16 17:43:10 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d5f4edf2-1885-43b7-b794-82dce639e32a tempest-VolumesActionsTest-1412284646 None] Lock "cinder-2109ac70-7ac7-4588-a7e9-5ecddd478aa5-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:43:11 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:43:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Flow 'volume_create_manager' (7e1cd9e9-70f3-4fbe-8586-861f8353a9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:43:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd785176-03fe-49e8-9f86-7c4481cbef9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:43:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd785176-03fe-49e8-9f86-7c4481cbef9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1443685312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17a55179-a9f3-42e9-b02b-1ed30c6bfa9a,host='devstack@QuobyteHD#QuobyteHD',id=e5c8b87a-cc3a-4d83-b21c-a046b414c646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b590ee94887e4a9e8b7c7c5ce1e89747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:43:11Z,use_quota=True,user_id='f9b75a7fd79741e38629fd7ead536847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c216ce7-3fe6-48a9-930e-10a04a93258d),volume_type_id=0c216ce7-3fe6-48a9-930e-10a04a93258d)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:43:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e97410-1474-4bc9-a679-d5a1bea5cb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:43:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e97410-1474-4bc9-a679-d5a1bea5cb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:43:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17742a0-4d2e-4788-a718-5a0c6985ddb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:43:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17742a0-4d2e-4788-a718-5a0c6985ddb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c8b87a-cc3a-4d83-b21c-a046b414c646', 'volume_name': 'volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:43:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b587c8-dcbf-44bd-9c48-83d54c8f2b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:43:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b587c8-dcbf-44bd-9c48-83d54c8f2b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:43:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa2fe10-ba69-463e-b97d-32f87bd1d0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:43:11 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Volume e5c8b87a-cc3a-4d83-b21c-a046b414c646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646', 'volume_size': 1} Sep 16 17:43:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:43:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:43:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=17a55179-a9f3-42e9-b02b-1ed30c6bfa9a,created_at=2026-09-16T15:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1443685312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17a55179-a9f3-42e9-b02b-1ed30c6bfa9a,host='devstack@QuobyteHD#QuobyteHD',id=e5c8b87a-cc3a-4d83-b21c-a046b414c646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b590ee94887e4a9e8b7c7c5ce1e89747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:43:11Z,use_quota=True,user_id='f9b75a7fd79741e38629fd7ead536847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c216ce7-3fe6-48a9-930e-10a04a93258d),volume_type_id=0c216ce7-3fe6-48a9-930e-10a04a93258d)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:43:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Creating volume e5c8b87a-cc3a-4d83-b21c-a046b414c646 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:43:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:43:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:43:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:43:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:43:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:43:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:43:11 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:43:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:11 devstack sudo[94664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646 1073741824 Sep 16 17:43:11 devstack sudo[94664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:12 devstack sudo[94664]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646 1073741824" returned: 0 in 0.667s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:12 devstack sudo[94672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646 Sep 16 17:43:12 devstack sudo[94672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:12 devstack sudo[94672]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646" returned: 0 in 0.663s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:12 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:43:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:43:12 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa2fe10-ba69-463e-b97d-32f87bd1d0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:43:12 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc19e3b-b098-4377-91dd-6197cf001eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:43:12 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Volume volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646 (e5c8b87a-cc3a-4d83-b21c-a046b414c646): created successfully Sep 16 17:43:12 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc19e3b-b098-4377-91dd-6197cf001eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:43:12 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Flow 'volume_create_manager' (7e1cd9e9-70f3-4fbe-8586-861f8353a9d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:43:12 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-c5202e23-57e9-4d75-a3ba-d3eda8257100 tempest-GroupSnapshotsTest-1443928250 None] Created volume successfully. Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Flow 'volume_create_manager' (5830b483-7c58-4071-9df7-e4fe3e1b9f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df63082-c47d-42bd-855f-8b5de37f0613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df63082-c47d-42bd-855f-8b5de37f0613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1259925925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17a55179-a9f3-42e9-b02b-1ed30c6bfa9a,host='devstack@QuobyteHD#QuobyteHD',id=1acaf2c2-391d-4854-9521-3d5bf9a65ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b590ee94887e4a9e8b7c7c5ce1e89747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:43:15Z,use_quota=True,user_id='f9b75a7fd79741e38629fd7ead536847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c216ce7-3fe6-48a9-930e-10a04a93258d),volume_type_id=0c216ce7-3fe6-48a9-930e-10a04a93258d)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ead4bf4-3712-4432-a45d-006a43ceb6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ead4bf4-3712-4432-a45d-006a43ceb6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9113b144-8ce8-41da-800e-481739a8d393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9113b144-8ce8-41da-800e-481739a8d393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1acaf2c2-391d-4854-9521-3d5bf9a65ea9', 'volume_name': 'volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3183bfc-7219-44e9-9aa9-e2481eb4add9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3183bfc-7219-44e9-9aa9-e2481eb4add9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409c9907-a03f-4533-b6c3-6d906d01377b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:43:15 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Volume 1acaf2c2-391d-4854-9521-3d5bf9a65ea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9', 'volume_size': 1} Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=17a55179-a9f3-42e9-b02b-1ed30c6bfa9a,created_at=2026-09-16T15:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1259925925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17a55179-a9f3-42e9-b02b-1ed30c6bfa9a,host='devstack@QuobyteHD#QuobyteHD',id=1acaf2c2-391d-4854-9521-3d5bf9a65ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b590ee94887e4a9e8b7c7c5ce1e89747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:43:15Z,use_quota=True,user_id='f9b75a7fd79741e38629fd7ead536847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c216ce7-3fe6-48a9-930e-10a04a93258d),volume_type_id=0c216ce7-3fe6-48a9-930e-10a04a93258d)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Creating volume 1acaf2c2-391d-4854-9521-3d5bf9a65ea9 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:43:15 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:15 devstack sudo[94694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9 1073741824 Sep 16 17:43:15 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:15 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9 1073741824" returned: 0 in 0.590s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:15 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9 Sep 16 17:43:15 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:16 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9" returned: 0 in 0.444s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:16 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:43:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:43:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409c9907-a03f-4533-b6c3-6d906d01377b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:43:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d77ab1-5d1f-4881-abec-dd32f56e51a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:43:16 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Volume volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9 (1acaf2c2-391d-4854-9521-3d5bf9a65ea9): created successfully Sep 16 17:43:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d77ab1-5d1f-4881-abec-dd32f56e51a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:43:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Flow 'volume_create_manager' (5830b483-7c58-4071-9df7-e4fe3e1b9f0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:43:16 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-3a743234-aa83-4e4c-954c-700b94ba6230 tempest-GroupSnapshotsTest-1443928250 None] Created volume successfully. Sep 16 17:43:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-74a4ed0a-b137-4f56-b1a4-9c0304a291a9 tempest-VolumesActionsTest-1412284646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:43:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-74a4ed0a-b137-4f56-b1a4-9c0304a291a9 tempest-VolumesActionsTest-1412284646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:43:17 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff467602-c8c7-40fc-8557-432795623268]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:43:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-74a4ed0a-b137-4f56-b1a4-9c0304a291a9 tempest-VolumesActionsTest-1412284646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:17 devstack sudo[94705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 Sep 16 17:43:17 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:17 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-c4db205d-58ef-4412-bd83-0de5934d3a43 tempest-GroupSnapshotsTest-1443928250 None] Update group completed successfully. Sep 16 17:43:17 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-74a4ed0a-b137-4f56-b1a4-9c0304a291a9 tempest-VolumesActionsTest-1412284646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5" returned: 0 in 0.567s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:17 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[91caff43-df11-4624-80ca-03d18b527919]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:43:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-74a4ed0a-b137-4f56-b1a4-9c0304a291a9 tempest-VolumesActionsTest-1412284646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:18 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 Sep 16 17:43:18 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:18 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-74a4ed0a-b137-4f56-b1a4-9c0304a291a9 tempest-VolumesActionsTest-1412284646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5" returned: 0 in 0.586s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-74a4ed0a-b137-4f56-b1a4-9c0304a291a9 tempest-VolumesActionsTest-1412284646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 /opt/stack/data/cinder/conversion/2109ac70-7ac7-4588-a7e9-5ecddd478aa5.temp_image.0097bca8-65a9-45d4-9acc-398cfe8a0bb0nz0u9bav.img {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:18 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 /opt/stack/data/cinder/conversion/2109ac70-7ac7-4588-a7e9-5ecddd478aa5.temp_image.0097bca8-65a9-45d4-9acc-398cfe8a0bb0nz0u9bav.img Sep 16 17:43:18 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:19 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-2d5ab3ed-9b81-4853-9037-591df6218119 tempest-GroupSnapshotsTest-1443928250 None] Update group completed successfully. Sep 16 17:43:20 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-f47ae243-1bfe-404d-919b-cbb16e48c676 tempest-GroupSnapshotsTest-1443928250 None] Update group completed successfully. Sep 16 17:43:22 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-e6aafee9-df36-406c-8db7-b3f65971bfde tempest-GroupSnapshotsTest-1443928250 None] Update group completed successfully. Sep 16 17:43:24 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] GroupSnapshot 1880ab35-7b85-47db-a61e-6eba90bc97d6: creating. Sep 16 17:43:25 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] Group snapshot 1880ab35-7b85-47db-a61e-6eba90bc97d6: creating. {{(pid=85899) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4171}} Sep 16 17:43:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:43:28 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-74a4ed0a-b137-4f56-b1a4-9c0304a291a9 tempest-VolumesActionsTest-1412284646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 /opt/stack/data/cinder/conversion/2109ac70-7ac7-4588-a7e9-5ecddd478aa5.temp_image.0097bca8-65a9-45d4-9acc-398cfe8a0bb0nz0u9bav.img" returned: 0 in 10.239s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:28 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[860df323-8f7d-44f8-bb32-ad04907187f6]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:43:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-74a4ed0a-b137-4f56-b1a4-9c0304a291a9 tempest-VolumesActionsTest-1412284646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:28 devstack sudo[94803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 Sep 16 17:43:28 devstack sudo[94803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:29 devstack sudo[94803]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-74a4ed0a-b137-4f56-b1a4-9c0304a291a9 tempest-VolumesActionsTest-1412284646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5" returned: 0 in 0.670s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:29 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-74a4ed0a-b137-4f56-b1a4-9c0304a291a9 tempest-VolumesActionsTest-1412284646 None] Image conversion details: src /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5, size 1024.00 MB, duration 10.24 sec, destination /opt/stack/data/cinder/conversion/2109ac70-7ac7-4588-a7e9-5ecddd478aa5.temp_image.0097bca8-65a9-45d4-9acc-398cfe8a0bb0nz0u9bav.img {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:43:29 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-74a4ed0a-b137-4f56-b1a4-9c0304a291a9 tempest-VolumesActionsTest-1412284646 None] Converted 1024.00 MB image at 99.98 MB/s Sep 16 17:43:29 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-74a4ed0a-b137-4f56-b1a4-9c0304a291a9 tempest-VolumesActionsTest-1412284646 None] 0097bca8-65a9-45d4-9acc-398cfe8a0bb0 was raw, no need to convert to raw {{(pid=85899) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 16 17:43:39 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=49,cinder:UPDATE=46,cinder:INSERT=8,cinder:DELETE=2 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:43:39 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:UPDATE=42,cinder:INSERT=11,cinder:SELECT=51 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Flow 'volume_create_manager' (338c6589-a272-44a4-ab1b-29547977c5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73101787-8f36-4a16-adb6-a33b9842e80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73101787-8f36-4a16-adb6-a33b9842e80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-830675639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fca223d0-678d-4d03-ad84-99ef50cc20b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8faf4d833a5b4e9baaa017bd8d4af3b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:43:48Z,use_quota=True,user_id='7439398770884a3388e997e284b23644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bdc5eb2-c549-4724-be2f-39c69be5823d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bdc5eb2-c549-4724-be2f-39c69be5823d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e4bd24-e17a-482d-8d82-19a677978418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e4bd24-e17a-482d-8d82-19a677978418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fca223d0-678d-4d03-ad84-99ef50cc20b9', 'volume_name': 'volume-fca223d0-678d-4d03-ad84-99ef50cc20b9', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e541a14-c346-4586-8435-ada2c1fe6cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e541a14-c346-4586-8435-ada2c1fe6cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2359aea0-821a-4a4f-8fa5-e74b7279da42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:43:48 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Volume fca223d0-678d-4d03-ad84-99ef50cc20b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fca223d0-678d-4d03-ad84-99ef50cc20b9', 'volume_size': 1} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Flow 'volume_create_manager' (4006b6ec-d328-4984-89b1-c3c12ee61368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb10170b-54de-47bf-9c55-563cc50e6746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb10170b-54de-47bf-9c55-563cc50e6746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1007282291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed666e2-427a-4902-878b-1bcdf7a00e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f963302b7c6c478883692250b1607568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:43:48Z,use_quota=True,user_id='24e8ba7983844366b762a1f5eb1de8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9f00b3-3ba3-46af-a09f-7fc5716c70b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9f00b3-3ba3-46af-a09f-7fc5716c70b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707b54d0-4607-43a2-afd1-1351029350d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707b54d0-4607-43a2-afd1-1351029350d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ed666e2-427a-4902-878b-1bcdf7a00e4f', 'volume_name': 'volume-3ed666e2-427a-4902-878b-1bcdf7a00e4f', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4908a0-27a8-47c7-b948-85d4383c87bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4908a0-27a8-47c7-b948-85d4383c87bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (488abc7b-6074-423e-a3c0-800021e7ddb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:43:48 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Volume 3ed666e2-427a-4902-878b-1bcdf7a00e4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ed666e2-427a-4902-878b-1bcdf7a00e4f', 'volume_size': 1} Sep 16 17:43:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:43:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-74a4ed0a-b137-4f56-b1a4-9c0304a291a9 tempest-VolumesActionsTest-1412284646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.037s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:43:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-74a4ed0a-b137-4f56-b1a4-9c0304a291a9 tempest-VolumesActionsTest-1412284646 None] Uploaded volume to glance image-id: 0097bca8-65a9-45d4-9acc-398cfe8a0bb0. {{(pid=85899) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 16 17:43:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 29.274s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:43:54 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] Creating offline snapshot 6c18e60e-abad-4e5c-9e53-122fb52ae1e6 of volume 1acaf2c2-391d-4854-9521-3d5bf9a65ea9 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:43:54 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-74a4ed0a-b137-4f56-b1a4-9c0304a291a9 tempest-VolumesActionsTest-1412284646 None] Copy volume to image completed successfully. Sep 16 17:43:54 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[76eb14b3-00aa-4b15-9189-e3dfd712c88c]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:43:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:54 devstack sudo[94996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9 Sep 16 17:43:54 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:54 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9" returned: 0 in 0.412s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.6c18e60e-abad-4e5c-9e53-122fb52ae1e6 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:54 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.6c18e60e-abad-4e5c-9e53-122fb52ae1e6 1G Sep 16 17:43:54 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:55 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.6c18e60e-abad-4e5c-9e53-122fb52ae1e6 1G" returned: 0 in 0.454s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.6c18e60e-abad-4e5c-9e53-122fb52ae1e6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:55 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.6c18e60e-abad-4e5c-9e53-122fb52ae1e6 Sep 16 17:43:55 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:55 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.6c18e60e-abad-4e5c-9e53-122fb52ae1e6" returned: 0 in 0.370s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:55 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.6c18e60e-abad-4e5c-9e53-122fb52ae1e6 is being set with open permissions: ugo+rw: NotImplementedError Sep 16 17:43:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.6c18e60e-abad-4e5c-9e53-122fb52ae1e6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:55 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.6c18e60e-abad-4e5c-9e53-122fb52ae1e6 Sep 16 17:43:55 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:55 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.6c18e60e-abad-4e5c-9e53-122fb52ae1e6" returned: 0 in 0.289s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:55 devstack sudo[95015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.info Sep 16 17:43:55 devstack sudo[95015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:56 devstack sudo[95015]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.info" returned: 0 in 0.291s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:56 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 16 17:43:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:56 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.info Sep 16 17:43:56 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:43:56 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.info" returned: 0 in 0.264s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.186s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:43:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:43:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:43:56 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] Creating offline snapshot c20efe05-adc3-4111-a8a3-0433f828d665 of volume e5c8b87a-cc3a-4d83-b21c-a046b414c646 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:43:56 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdb62e2-0232-42f7-9337-435f94d682b9]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:43:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:56 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646 Sep 16 17:43:56 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:56 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646" returned: 0 in 0.381s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.c20efe05-adc3-4111-a8a3-0433f828d665 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:56 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.c20efe05-adc3-4111-a8a3-0433f828d665 1G Sep 16 17:43:56 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:57 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.c20efe05-adc3-4111-a8a3-0433f828d665 1G" returned: 0 in 0.433s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.c20efe05-adc3-4111-a8a3-0433f828d665 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:57 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.c20efe05-adc3-4111-a8a3-0433f828d665 Sep 16 17:43:57 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:57 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.c20efe05-adc3-4111-a8a3-0433f828d665" returned: 0 in 0.280s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:57 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.c20efe05-adc3-4111-a8a3-0433f828d665 is being set with open permissions: ugo+rw: NotImplementedError Sep 16 17:43:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.c20efe05-adc3-4111-a8a3-0433f828d665 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:57 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.c20efe05-adc3-4111-a8a3-0433f828d665 Sep 16 17:43:57 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:57 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.c20efe05-adc3-4111-a8a3-0433f828d665" returned: 0 in 0.255s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:57 devstack sudo[95040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.info Sep 16 17:43:57 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:58 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.info" returned: 0 in 0.266s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:58 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.info is being set with open permissions: ugo+rw: NotImplementedError Sep 16 17:43:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:58 devstack sudo[95065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.info Sep 16 17:43:58 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:58 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.info" returned: 0 in 0.260s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.972s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:43:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.984s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:43:58 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1007282291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed666e2-427a-4902-878b-1bcdf7a00e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f963302b7c6c478883692250b1607568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:43:48Z,use_quota=True,user_id='24e8ba7983844366b762a1f5eb1de8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:43:58 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Creating volume 3ed666e2-427a-4902-878b-1bcdf7a00e4f {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:43:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:43:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:43:58 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:43:58 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:43:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:43:58 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:43:58 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:43:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ed666e2-427a-4902-878b-1bcdf7a00e4f 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:58 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ed666e2-427a-4902-878b-1bcdf7a00e4f 1073741824 Sep 16 17:43:58 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:58 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-80a720b4-d0f6-49e2-afc5-e0a1c39532d9 tempest-GroupSnapshotsTest-1443928250 None] group_snapshot 1880ab35-7b85-47db-a61e-6eba90bc97d6: created successfully Sep 16 17:43:58 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ed666e2-427a-4902-878b-1bcdf7a00e4f 1073741824" returned: 0 in 0.473s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ed666e2-427a-4902-878b-1bcdf7a00e4f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:59 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ed666e2-427a-4902-878b-1bcdf7a00e4f Sep 16 17:43:59 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:59 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ed666e2-427a-4902-878b-1bcdf7a00e4f" returned: 0 in 0.231s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:59 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:43:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:43:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.951s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:43:59 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (488abc7b-6074-423e-a3c0-800021e7ddb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ed666e2-427a-4902-878b-1bcdf7a00e4f', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:43:59 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a3a6834-b07b-4f5c-b9ea-d72c2250584e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:43:59 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb24fdb5-566b-480b-b56d-5a3cc2494364]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:43:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:59 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Volume volume-3ed666e2-427a-4902-878b-1bcdf7a00e4f (3ed666e2-427a-4902-878b-1bcdf7a00e4f): created successfully Sep 16 17:43:59 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a3a6834-b07b-4f5c-b9ea-d72c2250584e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:43:59 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Flow 'volume_create_manager' (4006b6ec-d328-4984-89b1-c3c12ee61368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:43:59 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-a4847d8f-1150-47c3-88ff-177066153323 tempest-TestMinimumBasicScenario-141028705 None] Created volume successfully. Sep 16 17:43:59 devstack sudo[95077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 Sep 16 17:43:59 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:59 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] group_snapshot 1880ab35-7b85-47db-a61e-6eba90bc97d6: deleting Sep 16 17:43:59 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] group_snapshot 1880ab35-7b85-47db-a61e-6eba90bc97d6: deleting {{(pid=85899) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4346}} Sep 16 17:43:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "cinder-quobyte-1acaf2c2-391d-4854-9521-3d5bf9a65ea9" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:43:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-1acaf2c2-391d-4854-9521-3d5bf9a65ea9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:43:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "cinder-quobyte-6c18e60e-abad-4e5c-9e53-122fb52ae1e6" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:43:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-6c18e60e-abad-4e5c-9e53-122fb52ae1e6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:43:59 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Deleting offline snapshot 6c18e60e-abad-4e5c-9e53-122fb52ae1e6 of volume 1acaf2c2-391d-4854-9521-3d5bf9a65ea9 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:43:59 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] snapshot_file for this snap is: volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.6c18e60e-abad-4e5c-9e53-122fb52ae1e6 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:43:59 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[375a9bb1-7d95-4090-b01a-b961ca3fdc90]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:43:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.6c18e60e-abad-4e5c-9e53-122fb52ae1e6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:59 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root Sep 16 17:43:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5" returned: 0 in 0.419s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:43:59 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e12573-5b85-4479-8496-926f251baead]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:43:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:43:59 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.6c18e60e-abad-4e5c-9e53-122fb52ae1e6 Sep 16 17:43:59 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:43:59 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 Sep 16 17:43:59 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:00 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.6c18e60e-abad-4e5c-9e53-122fb52ae1e6" returned: 0 in 0.402s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:44:00 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb0d59c-7952-4247-95a2-4ca0cc97179f]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:44:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:00 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5" returned: 0 in 0.453s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 /opt/stack/data/cinder/conversion/2109ac70-7ac7-4588-a7e9-5ecddd478aa5.temp_image.c49f4b33-24e7-4bce-9d75-e2330e1b65c0rrtdw2gd.img {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:00 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9 Sep 16 17:44:00 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:00 devstack sudo[95093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 /opt/stack/data/cinder/conversion/2109ac70-7ac7-4588-a7e9-5ecddd478aa5.temp_image.c49f4b33-24e7-4bce-9d75-e2330e1b65c0rrtdw2gd.img Sep 16 17:44:00 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:00 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9" returned: 0 in 0.426s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.6c18e60e-abad-4e5c-9e53-122fb52ae1e6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:00 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.6c18e60e-abad-4e5c-9e53-122fb52ae1e6 Sep 16 17:44:00 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-720a7f47-9dab-45f4-a652-9993a3a662a0 req-4e939ce9-4e46-4a34-9cd0-a99588e4477a tempest-TestMinimumBasicScenario-141028705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:44:01 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.6c18e60e-abad-4e5c-9e53-122fb52ae1e6" returned: 0 in 0.893s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.6c18e60e-abad-4e5c-9e53-122fb52ae1e6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:01 devstack sudo[95130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.6c18e60e-abad-4e5c-9e53-122fb52ae1e6 Sep 16 17:44:01 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:01 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9.6c18e60e-abad-4e5c-9e53-122fb52ae1e6" returned: 0 in 0.462s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-6c18e60e-abad-4e5c-9e53-122fb52ae1e6" released by "_delete_snapshot" :: held 2.366s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:44:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-1acaf2c2-391d-4854-9521-3d5bf9a65ea9" released by "delete_snapshot" :: held 2.404s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:44:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "cinder-quobyte-e5c8b87a-cc3a-4d83-b21c-a046b414c646" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:44:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-e5c8b87a-cc3a-4d83-b21c-a046b414c646" acquired by "delete_snapshot" :: waited 0.032s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:44:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "cinder-quobyte-c20efe05-adc3-4111-a8a3-0433f828d665" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:44:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-c20efe05-adc3-4111-a8a3-0433f828d665" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:44:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Deleting offline snapshot c20efe05-adc3-4111-a8a3-0433f828d665 of volume e5c8b87a-cc3a-4d83-b21c-a046b414c646 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:44:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] snapshot_file for this snap is: volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.c20efe05-adc3-4111-a8a3-0433f828d665 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:44:02 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dc975d-2734-4471-b342-7c100c0606cb]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:44:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.c20efe05-adc3-4111-a8a3-0433f828d665 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:44:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:44:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:44:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:44:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:44:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:44:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:02 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:44:02 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:02 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.c20efe05-adc3-4111-a8a3-0433f828d665 Sep 16 17:44:02 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:02 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.665s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:44:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager._thread_info {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:44:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread count: 28 {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:44:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread info: [<_MainThread(MainThread, started 123748124422272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:44:03 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.c20efe05-adc3-4111-a8a3-0433f828d665" returned: 0 in 0.868s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:44:03 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[00827d81-5e73-46e7-bd2d-7d353bd3daf3]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:44:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:03 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646 Sep 16 17:44:03 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:04 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646" returned: 0 in 0.913s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.c20efe05-adc3-4111-a8a3-0433f828d665 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:04 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.c20efe05-adc3-4111-a8a3-0433f828d665 Sep 16 17:44:04 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:04 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.c20efe05-adc3-4111-a8a3-0433f828d665" returned: 0 in 0.863s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.c20efe05-adc3-4111-a8a3-0433f828d665 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:04 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.c20efe05-adc3-4111-a8a3-0433f828d665 Sep 16 17:44:04 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:05 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646.c20efe05-adc3-4111-a8a3-0433f828d665" returned: 0 in 0.417s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:05 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-c20efe05-adc3-4111-a8a3-0433f828d665" released by "_delete_snapshot" :: held 3.328s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:44:05 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-e5c8b87a-cc3a-4d83-b21c-a046b414c646" released by "delete_snapshot" :: held 3.400s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:44:05 devstack cinder-volume[85899]: WARNING cinder.quota [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1559357661 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1559357661, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:44:05 devstack cinder-volume[85899]: WARNING cinder.quota [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1559357661 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1559357661, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:44:05 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Created reservations ['79fdaa70-dc42-4a72-80b5-6e4be3d063cd', 'ac32608d-d1c8-4653-b1cb-fe902743da32', 'a2e9c345-55da-45d6-92ab-c0a9b6ebdd27', '0160f493-14a9-41e6-bab3-e6042eeba989'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:44:06 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] Created reservations ['c6ba3119-c8a5-45b5-8bfb-09dafdae8678', '734053c7-54f7-4b45-aca2-ada3e577df71', 'dc19b59f-b450-42f7-b634-8b642c1cd224', '501c1a3f-9b63-40ee-979d-d9860bc6343d'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:44:06 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5f49f55d-5eec-4ceb-80f5-9fb750207dbb tempest-GroupSnapshotsTest-1443928250 None] group_snapshot 1880ab35-7b85-47db-a61e-6eba90bc97d6: deleted successfully Sep 16 17:44:07 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "cinder-quobyte-1acaf2c2-391d-4854-9521-3d5bf9a65ea9" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:44:07 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-1acaf2c2-391d-4854-9521-3d5bf9a65ea9" acquired by "delete_volume" :: waited 0.062s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:44:07 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99d48bc-2eac-4626-9c1a-7c1b3cc3e3b9]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:44:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:07 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 /opt/stack/data/cinder/conversion/2109ac70-7ac7-4588-a7e9-5ecddd478aa5.temp_image.c49f4b33-24e7-4bce-9d75-e2330e1b65c0rrtdw2gd.img" returned: 0 in 7.409s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:07 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[24412b6a-47f1-4b9f-b004-7f1e1d98b25b]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:44:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:07 devstack sudo[95157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9 Sep 16 17:44:07 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:07 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 Sep 16 17:44:07 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:07 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9" returned: 0 in 0.394s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:07 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9 Sep 16 17:44:07 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:08 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5" returned: 0 in 0.561s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:08 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] Image conversion details: src /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5, size 1024.00 MB, duration 7.41 sec, destination /opt/stack/data/cinder/conversion/2109ac70-7ac7-4588-a7e9-5ecddd478aa5.temp_image.c49f4b33-24e7-4bce-9d75-e2330e1b65c0rrtdw2gd.img {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:44:08 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] Converted 1024.00 MB image at 138.19 MB/s Sep 16 17:44:08 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] c49f4b33-24e7-4bce-9d75-e2330e1b65c0 was raw, converting to qcow2 {{(pid=85899) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 16 17:44:08 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b294b9e2-baca-4463-aad5-1572124374f2]: (4, 'raw') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:44:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2109ac70-7ac7-4588-a7e9-5ecddd478aa5.temp_image.c49f4b33-24e7-4bce-9d75-e2330e1b65c0rrtdw2gd.img {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:08 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1acaf2c2-391d-4854-9521-3d5bf9a65ea9" returned: 0 in 0.259s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-1acaf2c2-391d-4854-9521-3d5bf9a65ea9" released by "delete_volume" :: held 0.778s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:44:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "cinder-quobyte-e5c8b87a-cc3a-4d83-b21c-a046b414c646" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:44:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-e5c8b87a-cc3a-4d83-b21c-a046b414c646" acquired by "delete_volume" :: waited 0.015s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:44:08 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e3cd80-02c1-414a-a96e-d9df46235b40]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:44:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:08 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2109ac70-7ac7-4588-a7e9-5ecddd478aa5.temp_image.c49f4b33-24e7-4bce-9d75-e2330e1b65c0rrtdw2gd.img Sep 16 17:44:08 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:08 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646 Sep 16 17:44:08 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:08 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2109ac70-7ac7-4588-a7e9-5ecddd478aa5.temp_image.c49f4b33-24e7-4bce-9d75-e2330e1b65c0rrtdw2gd.img" returned: 0 in 0.351s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2109ac70-7ac7-4588-a7e9-5ecddd478aa5.temp_image.c49f4b33-24e7-4bce-9d75-e2330e1b65c0rrtdw2gd.img {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:08 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2109ac70-7ac7-4588-a7e9-5ecddd478aa5.temp_image.c49f4b33-24e7-4bce-9d75-e2330e1b65c0rrtdw2gd.img Sep 16 17:44:08 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:08 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646" returned: 0 in 0.396s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:08 devstack sudo[95182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646 Sep 16 17:44:08 devstack sudo[95182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:08 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2109ac70-7ac7-4588-a7e9-5ecddd478aa5.temp_image.c49f4b33-24e7-4bce-9d75-e2330e1b65c0rrtdw2gd.img" returned: 1 in 0.349s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2109ac70-7ac7-4588-a7e9-5ecddd478aa5.temp_image.c49f4b33-24e7-4bce-9d75-e2330e1b65c0rrtdw2gd.img' failed. Not Retrying. {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:44:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2109ac70-7ac7-4588-a7e9-5ecddd478aa5.temp_image.c49f4b33-24e7-4bce-9d75-e2330e1b65c0rrtdw2gd.img /opt/stack/data/cinder/conversion/vol_upload_up6mn8_a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:08 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2109ac70-7ac7-4588-a7e9-5ecddd478aa5.temp_image.c49f4b33-24e7-4bce-9d75-e2330e1b65c0rrtdw2gd.img /opt/stack/data/cinder/conversion/vol_upload_up6mn8_a Sep 16 17:44:08 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:08 devstack sudo[95182]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e5c8b87a-cc3a-4d83-b21c-a046b414c646" returned: 0 in 0.265s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-e5c8b87a-cc3a-4d83-b21c-a046b414c646" released by "delete_volume" :: held 0.718s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:44:09 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] Created reservations ['fb8bfeaa-7cbf-4836-afb2-d7ad11debd61'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:44:09 devstack cinder-volume[85899]: WARNING cinder.quota [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1559357661 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1559357661, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:44:09 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] Created reservations ['0d83f260-8d2d-4885-80d4-9fffb7d0a2b1', '6b5dfde4-f8ba-48ab-bf70-07f0b8f27121', '6d7c639d-cefe-4388-8d87-ca0baf904b21', 'e6b11910-b4c6-483b-b0e4-a473df72abd8'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:44:09 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] Created reservations ['3f01ca4e-8159-4d85-baec-c4fae80741f9', 'a9222a08-2120-47e7-9c05-f94ad3f73324', '4c8751d7-abc7-46ab-b541-d49c453bb93b', '775eec58-ab38-43c9-91b4-2a39bcefcde0'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:44:09 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2109ac70-7ac7-4588-a7e9-5ecddd478aa5.temp_image.c49f4b33-24e7-4bce-9d75-e2330e1b65c0rrtdw2gd.img /opt/stack/data/cinder/conversion/vol_upload_up6mn8_a" returned: 0 in 0.263s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:09 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] Image conversion details: src /opt/stack/data/cinder/conversion/2109ac70-7ac7-4588-a7e9-5ecddd478aa5.temp_image.c49f4b33-24e7-4bce-9d75-e2330e1b65c0rrtdw2gd.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_up6mn8_a {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:44:09 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 16 17:44:09 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a56ccc3-70ba-40e9-9dbf-170fbec9cddd]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:44:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_up6mn8_a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:09 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_up6mn8_a Sep 16 17:44:09 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:44:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:44:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:44:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:44:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:44:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:09 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:44:09 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:09 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_up6mn8_a" returned: 0 in 0.335s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:09 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.242s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:09 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:44:09 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-6f36b6fc-dec8-4070-a587-8900d059ec95 tempest-GroupSnapshotsTest-1443928250 None] Delete group completed successfully. Sep 16 17:44:10 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-a4ce1769-5a0e-4536-b8f8-847fae2231b9 tempest-GroupSnapshotsTest-1443928250 None] Group tempest-GroupSnapshotsTest-Group-642425223: creating Sep 16 17:44:10 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-a4ce1769-5a0e-4536-b8f8-847fae2231b9 tempest-GroupSnapshotsTest-1443928250 None] Group tempest-GroupSnapshotsTest-Group-642425223: created successfully Sep 16 17:44:10 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-a4ce1769-5a0e-4536-b8f8-847fae2231b9 tempest-GroupSnapshotsTest-1443928250 None] Create group completed successfully. Sep 16 17:44:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.513s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:44:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] Uploaded volume to glance image-id: c49f4b33-24e7-4bce-9d75-e2330e1b65c0. {{(pid=85899) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 16 17:44:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.378s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:44:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-830675639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fca223d0-678d-4d03-ad84-99ef50cc20b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8faf4d833a5b4e9baaa017bd8d4af3b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:43:48Z,use_quota=True,user_id='7439398770884a3388e997e284b23644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:44:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Creating volume fca223d0-678d-4d03-ad84-99ef50cc20b9 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:44:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:44:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:44:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:44:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:44:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:44:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:44:10 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:44:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fca223d0-678d-4d03-ad84-99ef50cc20b9 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:10 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fca223d0-678d-4d03-ad84-99ef50cc20b9 1073741824 Sep 16 17:44:10 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:10 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-ff8c74b5-7d88-4a57-897e-20f33c98c0ad tempest-VolumesActionsTest-1412284646 None] Copy volume to image completed successfully. Sep 16 17:44:11 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fca223d0-678d-4d03-ad84-99ef50cc20b9 1073741824" returned: 0 in 0.462s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fca223d0-678d-4d03-ad84-99ef50cc20b9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:11 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fca223d0-678d-4d03-ad84-99ef50cc20b9 Sep 16 17:44:11 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:11 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fca223d0-678d-4d03-ad84-99ef50cc20b9" returned: 0 in 0.285s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:44:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:44:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-720a7f47-9dab-45f4-a652-9993a3a662a0 req-4e939ce9-4e46-4a34-9cd0-a99588e4477a tempest-TestMinimumBasicScenario-141028705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.214s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:44:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-720a7f47-9dab-45f4-a652-9993a3a662a0 req-4e939ce9-4e46-4a34-9cd0-a99588e4477a tempest-TestMinimumBasicScenario-141028705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:44:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2359aea0-821a-4a4f-8fa5-e74b7279da42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fca223d0-678d-4d03-ad84-99ef50cc20b9', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0078f13-777d-4d55-b135-ee3186e58f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:11 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Volume volume-fca223d0-678d-4d03-ad84-99ef50cc20b9 (fca223d0-678d-4d03-ad84-99ef50cc20b9): created successfully Sep 16 17:44:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0078f13-777d-4d55-b135-ee3186e58f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Flow 'volume_create_manager' (338c6589-a272-44a4-ab1b-29547977c5e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:44:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-720a7f47-9dab-45f4-a652-9993a3a662a0 req-4e939ce9-4e46-4a34-9cd0-a99588e4477a tempest-TestMinimumBasicScenario-141028705 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7', 'name': 'volume-3ed666e2-427a-4902-878b-1bcdf7a00e4f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ce789c7-66f1-4087-8bc7-5d7bc5af86e3', 'enforce_multipath': True} {{(pid=85899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4920}} Sep 16 17:44:11 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-820e2ca5-ad13-4c6e-925b-cd1e9f56a357 tempest-AttachVolumeTestJSON-115136149 None] Created volume successfully. Sep 16 17:44:11 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-720a7f47-9dab-45f4-a652-9993a3a662a0 req-4e939ce9-4e46-4a34-9cd0-a99588e4477a tempest-TestMinimumBasicScenario-141028705 None] attachment_update completed successfully. Sep 16 17:44:11 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-eb1df9a7-7e7a-4c61-b3d7-f0b96aad46fe tempest-VolumesActionsTest-1412284646 None] Acquiring lock "cinder-2109ac70-7ac7-4588-a7e9-5ecddd478aa5-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:44:11 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-eb1df9a7-7e7a-4c61-b3d7-f0b96aad46fe tempest-VolumesActionsTest-1412284646 None] Lock "cinder-2109ac70-7ac7-4588-a7e9-5ecddd478aa5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:44:11 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-eb1df9a7-7e7a-4c61-b3d7-f0b96aad46fe tempest-VolumesActionsTest-1412284646 None] Acquiring lock "cinder-quobyte-2109ac70-7ac7-4588-a7e9-5ecddd478aa5" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:44:11 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-eb1df9a7-7e7a-4c61-b3d7-f0b96aad46fe tempest-VolumesActionsTest-1412284646 None] Lock "cinder-quobyte-2109ac70-7ac7-4588-a7e9-5ecddd478aa5" acquired by "delete_volume" :: waited 0.032s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0bcffe-3b4c-4027-987a-201f7f79bff7]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-eb1df9a7-7e7a-4c61-b3d7-f0b96aad46fe tempest-VolumesActionsTest-1412284646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Flow 'volume_create_manager' (f5af9dfd-2643-43b3-8cbf-d70eacd3908e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a802663-090f-4667-8d59-1921e3bdd3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a802663-090f-4667-8d59-1921e3bdd3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1463281869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b9e56ae5-31fa-409b-ac2e-8a518d01845a,host='devstack@QuobyteHD#QuobyteHD',id=d0caa604-9227-4147-be60-c986861a3e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b590ee94887e4a9e8b7c7c5ce1e89747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:44:12Z,use_quota=True,user_id='f9b75a7fd79741e38629fd7ead536847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd3f23b3-f5b4-47f7-bd8f-f0d83cd1c6c3),volume_type_id=dd3f23b3-f5b4-47f7-bd8f-f0d83cd1c6c3)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9244c0-5e4c-4474-a686-d67e3c1bdfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9244c0-5e4c-4474-a686-d67e3c1bdfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e87c18-a9a0-4225-8943-805161158bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e87c18-a9a0-4225-8943-805161158bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0caa604-9227-4147-be60-c986861a3e94', 'volume_name': 'volume-d0caa604-9227-4147-be60-c986861a3e94', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63fb84c1-e1f4-427a-aa1d-15f4bfa492c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63fb84c1-e1f4-427a-aa1d-15f4bfa492c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (208384bf-71db-4e39-94cb-3b4415e8dd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:12 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Volume d0caa604-9227-4147-be60-c986861a3e94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0caa604-9227-4147-be60-c986861a3e94', 'volume_size': 1} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b9e56ae5-31fa-409b-ac2e-8a518d01845a,created_at=2026-09-16T15:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1463281869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b9e56ae5-31fa-409b-ac2e-8a518d01845a,host='devstack@QuobyteHD#QuobyteHD',id=d0caa604-9227-4147-be60-c986861a3e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b590ee94887e4a9e8b7c7c5ce1e89747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:44:12Z,use_quota=True,user_id='f9b75a7fd79741e38629fd7ead536847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd3f23b3-f5b4-47f7-bd8f-f0d83cd1c6c3),volume_type_id=dd3f23b3-f5b4-47f7-bd8f-f0d83cd1c6c3)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Creating volume d0caa604-9227-4147-be60-c986861a3e94 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:44:12 devstack sudo[95308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:44:12 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:44:12 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:12 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94 1073741824 Sep 16 17:44:12 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:12 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-eb1df9a7-7e7a-4c61-b3d7-f0b96aad46fe tempest-VolumesActionsTest-1412284646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5" returned: 0 in 0.532s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-eb1df9a7-7e7a-4c61-b3d7-f0b96aad46fe tempest-VolumesActionsTest-1412284646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:12 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5 Sep 16 17:44:12 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:12 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94 1073741824" returned: 0 in 0.612s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:12 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-eb1df9a7-7e7a-4c61-b3d7-f0b96aad46fe tempest-VolumesActionsTest-1412284646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2109ac70-7ac7-4588-a7e9-5ecddd478aa5" returned: 0 in 0.320s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-eb1df9a7-7e7a-4c61-b3d7-f0b96aad46fe tempest-VolumesActionsTest-1412284646 None] Lock "cinder-quobyte-2109ac70-7ac7-4588-a7e9-5ecddd478aa5" released by "delete_volume" :: held 0.928s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:44:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:12 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94 Sep 16 17:44:12 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:13 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-eb1df9a7-7e7a-4c61-b3d7-f0b96aad46fe tempest-VolumesActionsTest-1412284646 None] Created reservations ['456cbfad-2e2a-4dd3-8ecf-497750c025ce', '2d8e97cd-0848-41aa-a054-15ef5627cbb9', '5f04f0d9-bf6b-452d-9fbb-ac4f01500127', 'c2ff9b3d-4c5a-4a3d-93a5-ae49da14c263'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:44:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-d37a63b6-4a50-47bd-8c9c-50b3a6bff517 req-73fa7f2f-b87c-4034-88d8-5b6952baf00e tempest-AttachVolumeTestJSON-115136149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:44:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-eb1df9a7-7e7a-4c61-b3d7-f0b96aad46fe tempest-VolumesActionsTest-1412284646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:44:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-eb1df9a7-7e7a-4c61-b3d7-f0b96aad46fe tempest-VolumesActionsTest-1412284646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:44:13 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-eb1df9a7-7e7a-4c61-b3d7-f0b96aad46fe tempest-VolumesActionsTest-1412284646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:44:13 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-eb1df9a7-7e7a-4c61-b3d7-f0b96aad46fe tempest-VolumesActionsTest-1412284646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:44:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-eb1df9a7-7e7a-4c61-b3d7-f0b96aad46fe tempest-VolumesActionsTest-1412284646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:44:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-eb1df9a7-7e7a-4c61-b3d7-f0b96aad46fe tempest-VolumesActionsTest-1412284646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:13 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:44:13 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:13 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94" returned: 0 in 0.328s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:13 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:44:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:44:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-d37a63b6-4a50-47bd-8c9c-50b3a6bff517 req-73fa7f2f-b87c-4034-88d8-5b6952baf00e tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.219s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:44:13 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (208384bf-71db-4e39-94cb-3b4415e8dd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0caa604-9227-4147-be60-c986861a3e94', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:13 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81adbd80-d4e1-42d4-8615-c674bd56ba4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-d37a63b6-4a50-47bd-8c9c-50b3a6bff517 req-73fa7f2f-b87c-4034-88d8-5b6952baf00e tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:44:13 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Volume volume-d0caa604-9227-4147-be60-c986861a3e94 (d0caa604-9227-4147-be60-c986861a3e94): created successfully Sep 16 17:44:13 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81adbd80-d4e1-42d4-8615-c674bd56ba4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:13 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Flow 'volume_create_manager' (f5af9dfd-2643-43b3-8cbf-d70eacd3908e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:44:13 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:13 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5d5faf5b-a642-45a5-b19f-962cc218fbb4 tempest-GroupSnapshotsTest-1443928250 None] Created volume successfully. Sep 16 17:44:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-eb1df9a7-7e7a-4c61-b3d7-f0b96aad46fe tempest-VolumesActionsTest-1412284646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.264s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:13 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-eb1df9a7-7e7a-4c61-b3d7-f0b96aad46fe tempest-VolumesActionsTest-1412284646 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:44:13 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-eb1df9a7-7e7a-4c61-b3d7-f0b96aad46fe tempest-VolumesActionsTest-1412284646 None] Deleted volume successfully. Sep 16 17:44:13 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-d37a63b6-4a50-47bd-8c9c-50b3a6bff517 req-73fa7f2f-b87c-4034-88d8-5b6952baf00e tempest-AttachVolumeTestJSON-115136149 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7', 'name': 'volume-fca223d0-678d-4d03-ad84-99ef50cc20b9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e59e8719-b2b0-4636-8593-65bcdf9044d1', 'enforce_multipath': True} {{(pid=85899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4920}} Sep 16 17:44:13 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-eb1df9a7-7e7a-4c61-b3d7-f0b96aad46fe tempest-VolumesActionsTest-1412284646 None] Lock "cinder-2109ac70-7ac7-4588-a7e9-5ecddd478aa5-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:44:13 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-d37a63b6-4a50-47bd-8c9c-50b3a6bff517 req-73fa7f2f-b87c-4034-88d8-5b6952baf00e tempest-AttachVolumeTestJSON-115136149 None] attachment_update completed successfully. Sep 16 17:44:14 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-f0199e85-de1b-47e1-b41d-97618f667def tempest-GroupSnapshotsTest-1443928250 None] GroupSnapshot 59cca453-3a2e-4d15-9371-2813ccc0f58b: creating. Sep 16 17:44:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f0199e85-de1b-47e1-b41d-97618f667def tempest-GroupSnapshotsTest-1443928250 None] Group snapshot 59cca453-3a2e-4d15-9371-2813ccc0f58b: creating. {{(pid=85899) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4171}} Sep 16 17:44:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f0199e85-de1b-47e1-b41d-97618f667def tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:44:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f0199e85-de1b-47e1-b41d-97618f667def tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:44:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-f0199e85-de1b-47e1-b41d-97618f667def tempest-GroupSnapshotsTest-1443928250 None] Creating offline snapshot 6f3ad8a8-574e-497f-b91f-cfff0aeb65a5 of volume d0caa604-9227-4147-be60-c986861a3e94 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:44:14 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94ac526-8dab-44fb-9867-d4f26b41ea89]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:44:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f0199e85-de1b-47e1-b41d-97618f667def tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:15 devstack sudo[95673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94 Sep 16 17:44:15 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:15 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f0199e85-de1b-47e1-b41d-97618f667def tempest-GroupSnapshotsTest-1443928250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94" returned: 0 in 0.481s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f0199e85-de1b-47e1-b41d-97618f667def tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.6f3ad8a8-574e-497f-b91f-cfff0aeb65a5 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:15 devstack sudo[95679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.6f3ad8a8-574e-497f-b91f-cfff0aeb65a5 1G Sep 16 17:44:15 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:15 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f0199e85-de1b-47e1-b41d-97618f667def tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.6f3ad8a8-574e-497f-b91f-cfff0aeb65a5 1G" returned: 0 in 0.496s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f0199e85-de1b-47e1-b41d-97618f667def tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0caa604-9227-4147-be60-c986861a3e94 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.6f3ad8a8-574e-497f-b91f-cfff0aeb65a5 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:15 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0caa604-9227-4147-be60-c986861a3e94 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.6f3ad8a8-574e-497f-b91f-cfff0aeb65a5 Sep 16 17:44:15 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:16 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f0199e85-de1b-47e1-b41d-97618f667def tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0caa604-9227-4147-be60-c986861a3e94 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.6f3ad8a8-574e-497f-b91f-cfff0aeb65a5" returned: 0 in 0.340s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:16 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-f0199e85-de1b-47e1-b41d-97618f667def tempest-GroupSnapshotsTest-1443928250 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.6f3ad8a8-574e-497f-b91f-cfff0aeb65a5 is being set with open permissions: ugo+rw: NotImplementedError Sep 16 17:44:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f0199e85-de1b-47e1-b41d-97618f667def tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.6f3ad8a8-574e-497f-b91f-cfff0aeb65a5 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:16 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.6f3ad8a8-574e-497f-b91f-cfff0aeb65a5 Sep 16 17:44:16 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:16 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f0199e85-de1b-47e1-b41d-97618f667def tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.6f3ad8a8-574e-497f-b91f-cfff0aeb65a5" returned: 0 in 0.283s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f0199e85-de1b-47e1-b41d-97618f667def tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:16 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.info Sep 16 17:44:16 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:16 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f0199e85-de1b-47e1-b41d-97618f667def tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.info" returned: 0 in 0.313s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:16 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-f0199e85-de1b-47e1-b41d-97618f667def tempest-GroupSnapshotsTest-1443928250 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.info is being set with open permissions: ugo+rw: NotImplementedError Sep 16 17:44:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f0199e85-de1b-47e1-b41d-97618f667def tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:16 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.info Sep 16 17:44:16 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:17 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f0199e85-de1b-47e1-b41d-97618f667def tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.info" returned: 0 in 0.306s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f0199e85-de1b-47e1-b41d-97618f667def tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.338s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:44:17 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-f0199e85-de1b-47e1-b41d-97618f667def tempest-GroupSnapshotsTest-1443928250 None] group_snapshot 59cca453-3a2e-4d15-9371-2813ccc0f58b: created successfully Sep 16 17:44:18 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-4a9318df-a598-41e1-9fc5-eaf2aafecc73 tempest-GroupSnapshotsTest-1443928250 None] group_snapshot 59cca453-3a2e-4d15-9371-2813ccc0f58b: deleting Sep 16 17:44:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-4a9318df-a598-41e1-9fc5-eaf2aafecc73 tempest-GroupSnapshotsTest-1443928250 None] group_snapshot 59cca453-3a2e-4d15-9371-2813ccc0f58b: deleting {{(pid=85899) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4346}} Sep 16 17:44:18 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4a9318df-a598-41e1-9fc5-eaf2aafecc73 tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "cinder-quobyte-d0caa604-9227-4147-be60-c986861a3e94" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:44:18 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4a9318df-a598-41e1-9fc5-eaf2aafecc73 tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-d0caa604-9227-4147-be60-c986861a3e94" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:44:18 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4a9318df-a598-41e1-9fc5-eaf2aafecc73 tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "cinder-quobyte-6f3ad8a8-574e-497f-b91f-cfff0aeb65a5" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:44:18 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4a9318df-a598-41e1-9fc5-eaf2aafecc73 tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-6f3ad8a8-574e-497f-b91f-cfff0aeb65a5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:44:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-4a9318df-a598-41e1-9fc5-eaf2aafecc73 tempest-GroupSnapshotsTest-1443928250 None] Deleting offline snapshot 6f3ad8a8-574e-497f-b91f-cfff0aeb65a5 of volume d0caa604-9227-4147-be60-c986861a3e94 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:44:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-4a9318df-a598-41e1-9fc5-eaf2aafecc73 tempest-GroupSnapshotsTest-1443928250 None] snapshot_file for this snap is: volume-d0caa604-9227-4147-be60-c986861a3e94.6f3ad8a8-574e-497f-b91f-cfff0aeb65a5 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:44:18 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5d3d02-f3cf-47bb-9ea5-de110d3588fa]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:44:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4a9318df-a598-41e1-9fc5-eaf2aafecc73 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.6f3ad8a8-574e-497f-b91f-cfff0aeb65a5 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:18 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.6f3ad8a8-574e-497f-b91f-cfff0aeb65a5 Sep 16 17:44:18 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:18 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4a9318df-a598-41e1-9fc5-eaf2aafecc73 tempest-GroupSnapshotsTest-1443928250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.6f3ad8a8-574e-497f-b91f-cfff0aeb65a5" returned: 0 in 0.546s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-4a9318df-a598-41e1-9fc5-eaf2aafecc73 tempest-GroupSnapshotsTest-1443928250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0caa604-9227-4147-be60-c986861a3e94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:44:18 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[68eb8159-0116-4f82-a504-58f139d00ec6]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:44:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4a9318df-a598-41e1-9fc5-eaf2aafecc73 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:19 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94 Sep 16 17:44:19 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:19 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4a9318df-a598-41e1-9fc5-eaf2aafecc73 tempest-GroupSnapshotsTest-1443928250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94" returned: 0 in 0.412s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4a9318df-a598-41e1-9fc5-eaf2aafecc73 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.6f3ad8a8-574e-497f-b91f-cfff0aeb65a5 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:19 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.6f3ad8a8-574e-497f-b91f-cfff0aeb65a5 Sep 16 17:44:19 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:19 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4a9318df-a598-41e1-9fc5-eaf2aafecc73 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.6f3ad8a8-574e-497f-b91f-cfff0aeb65a5" returned: 0 in 0.505s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4a9318df-a598-41e1-9fc5-eaf2aafecc73 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.6f3ad8a8-574e-497f-b91f-cfff0aeb65a5 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:19 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.6f3ad8a8-574e-497f-b91f-cfff0aeb65a5 Sep 16 17:44:19 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:20 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4a9318df-a598-41e1-9fc5-eaf2aafecc73 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94.6f3ad8a8-574e-497f-b91f-cfff0aeb65a5" returned: 0 in 0.326s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4a9318df-a598-41e1-9fc5-eaf2aafecc73 tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-6f3ad8a8-574e-497f-b91f-cfff0aeb65a5" released by "_delete_snapshot" :: held 1.975s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:44:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4a9318df-a598-41e1-9fc5-eaf2aafecc73 tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-d0caa604-9227-4147-be60-c986861a3e94" released by "delete_snapshot" :: held 2.005s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:44:20 devstack cinder-volume[85899]: WARNING cinder.quota [None req-4a9318df-a598-41e1-9fc5-eaf2aafecc73 tempest-GroupSnapshotsTest-1443928250 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1036292628 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1036292628, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:44:20 devstack cinder-volume[85899]: WARNING cinder.quota [None req-4a9318df-a598-41e1-9fc5-eaf2aafecc73 tempest-GroupSnapshotsTest-1443928250 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1036292628 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1036292628, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:44:20 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-4a9318df-a598-41e1-9fc5-eaf2aafecc73 tempest-GroupSnapshotsTest-1443928250 None] Created reservations ['101b9d2a-5599-407e-b34c-70cb7e8d0877', 'd87eceaf-2afb-47c4-abc2-47c7cc01b35b', '6bc09a54-994c-466b-aee3-e7618dc24cad', '3a35dc62-4fa7-43b5-a771-43c724da3446'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:44:20 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-4a9318df-a598-41e1-9fc5-eaf2aafecc73 tempest-GroupSnapshotsTest-1443928250 None] group_snapshot 59cca453-3a2e-4d15-9371-2813ccc0f58b: deleted successfully Sep 16 17:44:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-af3daa42-458d-4cd7-8b74-12451206def5 tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "cinder-quobyte-d0caa604-9227-4147-be60-c986861a3e94" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:44:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-af3daa42-458d-4cd7-8b74-12451206def5 tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-d0caa604-9227-4147-be60-c986861a3e94" acquired by "delete_volume" :: waited 0.033s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:44:21 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81d3a36-d808-49a2-ac67-947feafcd93b]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:44:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-af3daa42-458d-4cd7-8b74-12451206def5 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:21 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94 Sep 16 17:44:21 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:21 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-af3daa42-458d-4cd7-8b74-12451206def5 tempest-GroupSnapshotsTest-1443928250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94" returned: 0 in 0.598s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-af3daa42-458d-4cd7-8b74-12451206def5 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:21 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94 Sep 16 17:44:21 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:22 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-af3daa42-458d-4cd7-8b74-12451206def5 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d0caa604-9227-4147-be60-c986861a3e94" returned: 0 in 0.578s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-af3daa42-458d-4cd7-8b74-12451206def5 tempest-GroupSnapshotsTest-1443928250 None] Lock "cinder-quobyte-d0caa604-9227-4147-be60-c986861a3e94" released by "delete_volume" :: held 1.266s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:44:22 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-af3daa42-458d-4cd7-8b74-12451206def5 tempest-GroupSnapshotsTest-1443928250 None] Created reservations ['1ed1fb2e-aae1-420d-b939-e630f35470d1'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:44:22 devstack cinder-volume[85899]: WARNING cinder.quota [None req-af3daa42-458d-4cd7-8b74-12451206def5 tempest-GroupSnapshotsTest-1443928250 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1036292628 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1036292628, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:44:22 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-af3daa42-458d-4cd7-8b74-12451206def5 tempest-GroupSnapshotsTest-1443928250 None] Created reservations ['05ce2916-cdee-43ac-8580-9a2433df6e2d', '697de973-d623-406f-9228-7405bca4b206', '64a18465-c9db-49ea-abfe-906c05806e7a', 'c72b700e-26fb-4091-ad23-c6b27d628794'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:44:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-af3daa42-458d-4cd7-8b74-12451206def5 tempest-GroupSnapshotsTest-1443928250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:44:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-af3daa42-458d-4cd7-8b74-12451206def5 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:44:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-af3daa42-458d-4cd7-8b74-12451206def5 tempest-GroupSnapshotsTest-1443928250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:44:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-af3daa42-458d-4cd7-8b74-12451206def5 tempest-GroupSnapshotsTest-1443928250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:44:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-af3daa42-458d-4cd7-8b74-12451206def5 tempest-GroupSnapshotsTest-1443928250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:44:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-af3daa42-458d-4cd7-8b74-12451206def5 tempest-GroupSnapshotsTest-1443928250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:23 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:44:23 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:23 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-af3daa42-458d-4cd7-8b74-12451206def5 tempest-GroupSnapshotsTest-1443928250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.425s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:23 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-af3daa42-458d-4cd7-8b74-12451206def5 tempest-GroupSnapshotsTest-1443928250 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:44:23 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-af3daa42-458d-4cd7-8b74-12451206def5 tempest-GroupSnapshotsTest-1443928250 None] Delete group completed successfully. Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Flow 'volume_create_manager' (b8db1333-d994-4dbf-bfd3-5923cd4e363b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039fc4c6-5951-4121-8eaf-6ebd6befe2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039fc4c6-5951-4121-8eaf-6ebd6befe2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-494021134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9181845c-2223-4601-b98f-2bf90363f434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80711aa4927b499492a8dc1f66a02bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:44:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:44:30Z,use_quota=True,user_id='cc514cfe5e934351bec0d10f38dc0111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ac2375-2754-45a3-b1ae-6b2db03ac6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ac2375-2754-45a3-b1ae-6b2db03ac6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce6bd14-1ce5-48db-9497-c27648bd1b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce6bd14-1ce5-48db-9497-c27648bd1b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9181845c-2223-4601-b98f-2bf90363f434', 'volume_name': 'volume-9181845c-2223-4601-b98f-2bf90363f434', 'volume_size': 2}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c43b798-c34b-40d7-b42f-47204b610b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c43b798-c34b-40d7-b42f-47204b610b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ca5b5e-4847-4c93-93d0-23f664b92ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:30 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Volume 9181845c-2223-4601-b98f-2bf90363f434: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9181845c-2223-4601-b98f-2bf90363f434', 'volume_size': 2} Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-494021134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9181845c-2223-4601-b98f-2bf90363f434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80711aa4927b499492a8dc1f66a02bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:44:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:44:30Z,use_quota=True,user_id='cc514cfe5e934351bec0d10f38dc0111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Creating volume 9181845c-2223-4601-b98f-2bf90363f434 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:44:30 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434 2147483648 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:30 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434 2147483648 Sep 16 17:44:30 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:30 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434 2147483648" returned: 0 in 0.582s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:31 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434 Sep 16 17:44:31 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:31 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434" returned: 0 in 0.291s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:31 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:44:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:44:31 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ca5b5e-4847-4c93-93d0-23f664b92ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9181845c-2223-4601-b98f-2bf90363f434', 'volume_size': 2}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:31 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd1eaae7-89a8-49ac-9ade-8abce836141e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:31 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Volume volume-9181845c-2223-4601-b98f-2bf90363f434 (9181845c-2223-4601-b98f-2bf90363f434): created successfully Sep 16 17:44:31 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd1eaae7-89a8-49ac-9ade-8abce836141e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:31 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Flow 'volume_create_manager' (b8db1333-d994-4dbf-bfd3-5923cd4e363b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:44:31 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-11ae6f2a-b556-41da-8cec-d753d917828c tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Created volume successfully. Sep 16 17:44:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5eebc33a-a2d2-4680-a4bf-a1f1ca378660 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:44:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5eebc33a-a2d2-4680-a4bf-a1f1ca378660 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:44:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5eebc33a-a2d2-4680-a4bf-a1f1ca378660 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Creating offline snapshot f71338fe-ac53-4dc3-b09b-4df4177d68e9 of volume 9181845c-2223-4601-b98f-2bf90363f434 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:44:32 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0628476b-71cf-4c07-8e08-944928b07512]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:44:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5eebc33a-a2d2-4680-a4bf-a1f1ca378660 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:32 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434 Sep 16 17:44:32 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:33 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5eebc33a-a2d2-4680-a4bf-a1f1ca378660 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434" returned: 0 in 0.507s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5eebc33a-a2d2-4680-a4bf-a1f1ca378660 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.f71338fe-ac53-4dc3-b09b-4df4177d68e9 2G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:33 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.f71338fe-ac53-4dc3-b09b-4df4177d68e9 2G Sep 16 17:44:33 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:33 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5eebc33a-a2d2-4680-a4bf-a1f1ca378660 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.f71338fe-ac53-4dc3-b09b-4df4177d68e9 2G" returned: 0 in 0.623s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5eebc33a-a2d2-4680-a4bf-a1f1ca378660 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9181845c-2223-4601-b98f-2bf90363f434 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.f71338fe-ac53-4dc3-b09b-4df4177d68e9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:33 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9181845c-2223-4601-b98f-2bf90363f434 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.f71338fe-ac53-4dc3-b09b-4df4177d68e9 Sep 16 17:44:33 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:34 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5eebc33a-a2d2-4680-a4bf-a1f1ca378660 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9181845c-2223-4601-b98f-2bf90363f434 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.f71338fe-ac53-4dc3-b09b-4df4177d68e9" returned: 0 in 0.566s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:34 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-5eebc33a-a2d2-4680-a4bf-a1f1ca378660 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.f71338fe-ac53-4dc3-b09b-4df4177d68e9 is being set with open permissions: ugo+rw Sep 16 17:44:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5eebc33a-a2d2-4680-a4bf-a1f1ca378660 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.f71338fe-ac53-4dc3-b09b-4df4177d68e9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:34 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.f71338fe-ac53-4dc3-b09b-4df4177d68e9 Sep 16 17:44:34 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:34 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5eebc33a-a2d2-4680-a4bf-a1f1ca378660 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.f71338fe-ac53-4dc3-b09b-4df4177d68e9" returned: 0 in 0.303s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5eebc33a-a2d2-4680-a4bf-a1f1ca378660 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:34 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.info Sep 16 17:44:34 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:35 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5eebc33a-a2d2-4680-a4bf-a1f1ca378660 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.info" returned: 0 in 0.434s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:35 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-5eebc33a-a2d2-4680-a4bf-a1f1ca378660 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.info is being set with open permissions: ugo+rw Sep 16 17:44:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5eebc33a-a2d2-4680-a4bf-a1f1ca378660 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:35 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.info Sep 16 17:44:35 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:35 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5eebc33a-a2d2-4680-a4bf-a1f1ca378660 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.info" returned: 0 in 0.304s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5eebc33a-a2d2-4680-a4bf-a1f1ca378660 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.874s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:44:35 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5eebc33a-a2d2-4680-a4bf-a1f1ca378660 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Create snapshot completed successfully Sep 16 17:44:35 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bfc3c242-b602-43bd-8a10-1d63debe07a9 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Acquiring lock "cinder-f71338fe-ac53-4dc3-b09b-4df4177d68e9-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:44:35 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bfc3c242-b602-43bd-8a10-1d63debe07a9 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Lock "cinder-f71338fe-ac53-4dc3-b09b-4df4177d68e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:44:35 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bfc3c242-b602-43bd-8a10-1d63debe07a9 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Acquiring lock "cinder-quobyte-9181845c-2223-4601-b98f-2bf90363f434" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:44:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bfc3c242-b602-43bd-8a10-1d63debe07a9 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Lock "cinder-quobyte-9181845c-2223-4601-b98f-2bf90363f434" acquired by "delete_snapshot" :: waited 0.042s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:44:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bfc3c242-b602-43bd-8a10-1d63debe07a9 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Acquiring lock "cinder-quobyte-f71338fe-ac53-4dc3-b09b-4df4177d68e9" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:44:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bfc3c242-b602-43bd-8a10-1d63debe07a9 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Lock "cinder-quobyte-f71338fe-ac53-4dc3-b09b-4df4177d68e9" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:44:36 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-bfc3c242-b602-43bd-8a10-1d63debe07a9 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Deleting offline snapshot f71338fe-ac53-4dc3-b09b-4df4177d68e9 of volume 9181845c-2223-4601-b98f-2bf90363f434 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:44:36 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-bfc3c242-b602-43bd-8a10-1d63debe07a9 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] snapshot_file for this snap is: volume-9181845c-2223-4601-b98f-2bf90363f434.f71338fe-ac53-4dc3-b09b-4df4177d68e9 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:44:36 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5f2eab-c100-4834-a800-92da845f035e]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:44:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bfc3c242-b602-43bd-8a10-1d63debe07a9 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.f71338fe-ac53-4dc3-b09b-4df4177d68e9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:36 devstack sudo[95933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.f71338fe-ac53-4dc3-b09b-4df4177d68e9 Sep 16 17:44:36 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:36 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bfc3c242-b602-43bd-8a10-1d63debe07a9 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.f71338fe-ac53-4dc3-b09b-4df4177d68e9" returned: 0 in 0.566s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:36 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-bfc3c242-b602-43bd-8a10-1d63debe07a9 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9181845c-2223-4601-b98f-2bf90363f434(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:44:36 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[340fcea6-970f-4be7-b1f9-eb47ff712ea3]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:44:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bfc3c242-b602-43bd-8a10-1d63debe07a9 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:36 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434 Sep 16 17:44:36 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:37 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bfc3c242-b602-43bd-8a10-1d63debe07a9 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434" returned: 0 in 0.545s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bfc3c242-b602-43bd-8a10-1d63debe07a9 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.f71338fe-ac53-4dc3-b09b-4df4177d68e9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:37 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.f71338fe-ac53-4dc3-b09b-4df4177d68e9 Sep 16 17:44:37 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:37 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bfc3c242-b602-43bd-8a10-1d63debe07a9 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.f71338fe-ac53-4dc3-b09b-4df4177d68e9" returned: 0 in 0.521s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bfc3c242-b602-43bd-8a10-1d63debe07a9 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.f71338fe-ac53-4dc3-b09b-4df4177d68e9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:37 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.f71338fe-ac53-4dc3-b09b-4df4177d68e9 Sep 16 17:44:37 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:38 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bfc3c242-b602-43bd-8a10-1d63debe07a9 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434.f71338fe-ac53-4dc3-b09b-4df4177d68e9" returned: 0 in 0.292s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bfc3c242-b602-43bd-8a10-1d63debe07a9 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Lock "cinder-quobyte-f71338fe-ac53-4dc3-b09b-4df4177d68e9" released by "_delete_snapshot" :: held 2.093s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:44:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bfc3c242-b602-43bd-8a10-1d63debe07a9 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Lock "cinder-quobyte-9181845c-2223-4601-b98f-2bf90363f434" released by "delete_snapshot" :: held 2.129s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:44:38 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-bfc3c242-b602-43bd-8a10-1d63debe07a9 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Created reservations ['40db0573-530a-4848-a6f7-885256ab0199', 'd0bb39fe-233d-459a-b0a2-942e10c933cd', '0e62273d-7747-4b42-93a3-faa8b8bd8cd3', '50577f5e-7d99-4982-9e4b-5135761b5d56'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:44:38 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-bfc3c242-b602-43bd-8a10-1d63debe07a9 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Delete snapshot completed successfully. Sep 16 17:44:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bfc3c242-b602-43bd-8a10-1d63debe07a9 tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Lock "cinder-f71338fe-ac53-4dc3-b09b-4df4177d68e9-delete_snapshot" released by "delete_snapshot" :: held 2.301s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:44:38 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-aa47dacd-68e9-4e3f-8ef5-4fd378576e21 tempest-GroupsV314Test-1948011877 None] Group tempest-GroupsV314Test-Group-105621358: creating Sep 16 17:44:38 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-aa47dacd-68e9-4e3f-8ef5-4fd378576e21 tempest-GroupsV314Test-1948011877 None] Group tempest-GroupsV314Test-Group-105621358: created successfully Sep 16 17:44:38 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-aa47dacd-68e9-4e3f-8ef5-4fd378576e21 tempest-GroupsV314Test-1948011877 None] Create group completed successfully. Sep 16 17:44:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4aa5fc04-8559-4b04-b389-e4b91401a6cc tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Acquiring lock "cinder-9181845c-2223-4601-b98f-2bf90363f434-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:44:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4aa5fc04-8559-4b04-b389-e4b91401a6cc tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Lock "cinder-9181845c-2223-4601-b98f-2bf90363f434-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:44:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4aa5fc04-8559-4b04-b389-e4b91401a6cc tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Acquiring lock "cinder-quobyte-9181845c-2223-4601-b98f-2bf90363f434" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:44:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4aa5fc04-8559-4b04-b389-e4b91401a6cc tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Lock "cinder-quobyte-9181845c-2223-4601-b98f-2bf90363f434" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:44:39 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[919e0c1a-2b9c-48d7-ada0-4599b4499d76]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:44:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4aa5fc04-8559-4b04-b389-e4b91401a6cc tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:39 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434 Sep 16 17:44:39 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:39 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4aa5fc04-8559-4b04-b389-e4b91401a6cc tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434" returned: 0 in 0.378s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4aa5fc04-8559-4b04-b389-e4b91401a6cc tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:39 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434 Sep 16 17:44:39 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:40 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4aa5fc04-8559-4b04-b389-e4b91401a6cc tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9181845c-2223-4601-b98f-2bf90363f434" returned: 0 in 0.291s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4aa5fc04-8559-4b04-b389-e4b91401a6cc tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Lock "cinder-quobyte-9181845c-2223-4601-b98f-2bf90363f434" released by "delete_volume" :: held 0.743s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=94,cinder:UPDATE=95,cinder:INSERT=24,cinder:DELETE=4 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:UPDATE=79,cinder:SELECT=96,cinder:INSERT=18,cinder:DELETE=2 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-4aa5fc04-8559-4b04-b389-e4b91401a6cc tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Created reservations ['1c2c4e36-e4f9-43b2-b245-b0a7a5cce2c0', 'a2e22b70-9971-461a-a972-61f061094833', '6c2ed0a9-3c20-49bd-99ea-4c969b58cd3b', '46923b56-2cb9-4e59-81f8-3892996ff44a'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4aa5fc04-8559-4b04-b389-e4b91401a6cc tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4aa5fc04-8559-4b04-b389-e4b91401a6cc tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-4aa5fc04-8559-4b04-b389-e4b91401a6cc tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-4aa5fc04-8559-4b04-b389-e4b91401a6cc tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4aa5fc04-8559-4b04-b389-e4b91401a6cc tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4aa5fc04-8559-4b04-b389-e4b91401a6cc tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:40 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:44:40 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:40 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4aa5fc04-8559-4b04-b389-e4b91401a6cc tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.354s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-4aa5fc04-8559-4b04-b389-e4b91401a6cc tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:44:40 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-4aa5fc04-8559-4b04-b389-e4b91401a6cc tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Deleted volume successfully. Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4aa5fc04-8559-4b04-b389-e4b91401a6cc tempest-VolumesSnapshotNegativeTestJSON-1564224406 None] Lock "cinder-9181845c-2223-4601-b98f-2bf90363f434-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Flow 'volume_create_manager' (4183b2fd-a8ed-4c86-91c6-8a641df0714a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de6177d7-1305-4e38-b83b-68c925a2e56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de6177d7-1305-4e38-b83b-68c925a2e56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-638597218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=651e9f57-1452-41c2-8fe5-ebc3fbf4cdd4,host='devstack@QuobyteHD#QuobyteHD',id=d53dfdb3-acb1-4209-a1ce-f72ec118caba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7313f8d6e9f4c17a87489dd894895f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:44:41Z,use_quota=True,user_id='bcddbb59068f4f7184da0b9579ed0fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aba9bfd3-5ea4-4e1f-acd2-44589d97e07c),volume_type_id=aba9bfd3-5ea4-4e1f-acd2-44589d97e07c)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51186001-10dc-45f6-b10f-95353dc0a1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51186001-10dc-45f6-b10f-95353dc0a1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd771dec-7de1-4f69-8185-7b766778fe15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd771dec-7de1-4f69-8185-7b766778fe15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd53dfdb3-acb1-4209-a1ce-f72ec118caba', 'volume_name': 'volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38abeeaf-4275-44bb-b5c7-883a8efea711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38abeeaf-4275-44bb-b5c7-883a8efea711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8d5c6c8-95ab-453a-af30-58e75e982349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:40 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Volume d53dfdb3-acb1-4209-a1ce-f72ec118caba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba', 'volume_size': 1} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=651e9f57-1452-41c2-8fe5-ebc3fbf4cdd4,created_at=2026-09-16T15:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-638597218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=651e9f57-1452-41c2-8fe5-ebc3fbf4cdd4,host='devstack@QuobyteHD#QuobyteHD',id=d53dfdb3-acb1-4209-a1ce-f72ec118caba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7313f8d6e9f4c17a87489dd894895f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:44:41Z,use_quota=True,user_id='bcddbb59068f4f7184da0b9579ed0fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aba9bfd3-5ea4-4e1f-acd2-44589d97e07c),volume_type_id=aba9bfd3-5ea4-4e1f-acd2-44589d97e07c)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Creating volume d53dfdb3-acb1-4209-a1ce-f72ec118caba {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:44:40 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:44:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:40 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba 1073741824 Sep 16 17:44:40 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:41 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba 1073741824" returned: 0 in 0.487s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:41 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba Sep 16 17:44:41 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:41 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba" returned: 0 in 0.288s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:41 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:44:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:44:41 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8d5c6c8-95ab-453a-af30-58e75e982349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:41 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c695637-4f16-41d2-83b0-b7b8c382a8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:41 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Volume volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba (d53dfdb3-acb1-4209-a1ce-f72ec118caba): created successfully Sep 16 17:44:41 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c695637-4f16-41d2-83b0-b7b8c382a8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:41 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Flow 'volume_create_manager' (4183b2fd-a8ed-4c86-91c6-8a641df0714a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:44:41 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-b694e8de-ef79-4e5c-ace1-a3384a9f4422 tempest-GroupsV314Test-1948011877 None] Created volume successfully. Sep 16 17:44:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:44:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:44:43 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Cloning volume d53dfdb3-acb1-4209-a1ce-f72ec118caba to volume 0f018267-d180-433e-8ccb-601e6a8e4504 Sep 16 17:44:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Creating offline snapshot fd0cd663-804f-4042-882d-5de43daff6ce of volume d53dfdb3-acb1-4209-a1ce-f72ec118caba {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:44:43 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25f8078-ea6b-45db-9e97-ad29f38fd199]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:44:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:44 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba Sep 16 17:44:44 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:44 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba" returned: 0 in 0.601s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.fd0cd663-804f-4042-882d-5de43daff6ce 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:44 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.fd0cd663-804f-4042-882d-5de43daff6ce 1G Sep 16 17:44:44 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:45 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:44:45 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Flow 'volume_create_manager' (433d45b5-8e1c-4c82-9eab-ac69ac16a043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:44:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ec2317-d5d1-4d6e-961a-f805de8a3852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.fd0cd663-804f-4042-882d-5de43daff6ce 1G" returned: 0 in 0.709s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.fd0cd663-804f-4042-882d-5de43daff6ce {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ec2317-d5d1-4d6e-961a-f805de8a3852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1791636347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb11174c-5094-40ac-ba5d-2e4ef01adc13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddd4bc9fc694decb8c78407aadbbf47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:44:45Z,use_quota=True,user_id='24e26016d4cd4e72a71f07e5a82f3b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:45 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.fd0cd663-804f-4042-882d-5de43daff6ce Sep 16 17:44:45 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593d8f5f-9f39-438a-b320-5e328e15f77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593d8f5f-9f39-438a-b320-5e328e15f77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88034889-2a06-40ba-b388-0f6a23bd0530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88034889-2a06-40ba-b388-0f6a23bd0530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb11174c-5094-40ac-ba5d-2e4ef01adc13', 'volume_name': 'volume-bb11174c-5094-40ac-ba5d-2e4ef01adc13', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555e35b3-3b70-4cb4-91ef-bcd2cc024bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555e35b3-3b70-4cb4-91ef-bcd2cc024bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f070c3c-af4d-4967-bb08-460c3bae91df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:45 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Volume bb11174c-5094-40ac-ba5d-2e4ef01adc13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb11174c-5094-40ac-ba5d-2e4ef01adc13', 'volume_size': 1} Sep 16 17:44:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:44:45 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.fd0cd663-804f-4042-882d-5de43daff6ce" returned: 0 in 0.374s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:45 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.fd0cd663-804f-4042-882d-5de43daff6ce is being set with open permissions: ugo+rw: NotImplementedError Sep 16 17:44:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.fd0cd663-804f-4042-882d-5de43daff6ce {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:45 devstack sudo[96039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.fd0cd663-804f-4042-882d-5de43daff6ce Sep 16 17:44:45 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:45 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.fd0cd663-804f-4042-882d-5de43daff6ce" returned: 0 in 0.255s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:45 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.info Sep 16 17:44:45 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:46 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.info" returned: 0 in 0.275s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:46 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.info is being set with open permissions: ugo+rw: NotImplementedError Sep 16 17:44:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:46 devstack sudo[96045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.info Sep 16 17:44:46 devstack sudo[96045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:46 devstack sudo[96045]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.info" returned: 0 in 0.234s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Acquiring lock "cinder-quobyte-0f018267-d180-433e-8ccb-601e6a8e4504" by "_copy_volume_from_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:44:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Lock "cinder-quobyte-0f018267-d180-433e-8ccb-601e6a8e4504" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:44:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] snapshot: fd0cd663-804f-4042-882d-5de43daff6ce, volume: 0f018267-d180-433e-8ccb-601e6a8e4504, {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 17:44:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:44:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:44:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:44:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:44:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:44:46 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5645a925-5301-41f9-a7be-fceb35e7ec72]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:44:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.fd0cd663-804f-4042-882d-5de43daff6ce {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:46 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.fd0cd663-804f-4042-882d-5de43daff6ce Sep 16 17:44:46 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:46 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.fd0cd663-804f-4042-882d-5de43daff6ce" returned: 0 in 0.373s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:44:46 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b18d6c-a384-4eed-874b-0e9d1dab10bd]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:44:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:47 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba Sep 16 17:44:47 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:47 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba" returned: 0 in 0.429s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 17:44:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Creating direct copy from snapshot {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 17:44:47 devstack cinder-volume[85899]: DEBUG cinder.utils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Path /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0f018267-d180-433e-8ccb-601e6a8e4504 not found in is_blk_device check {{(pid=85899) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 17:44:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0f018267-d180-433e-8ccb-601e6a8e4504 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:47 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0f018267-d180-433e-8ccb-601e6a8e4504 Sep 16 17:44:47 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:48 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-a53c9a86-1108-42cb-a3d9-5809f3f1424f req-7fc9fc24-6cbd-43c4-ad1e-5500aad87d59 tempest-AttachVolumeTestJSON-115136149 None] Terminate volume connection completed successfully. Sep 16 17:44:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-a53c9a86-1108-42cb-a3d9-5809f3f1424f req-7fc9fc24-6cbd-43c4-ad1e-5500aad87d59 tempest-AttachVolumeTestJSON-115136149 None] Deleting attachment e59e8719-b2b0-4636-8593-65bcdf9044d1. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:44:55 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0f018267-d180-433e-8ccb-601e6a8e4504" returned: 0 in 8.320s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:55 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Image conversion details: src /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba, size 1024.00 MB, duration 8.32 sec, destination /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0f018267-d180-433e-8ccb-601e6a8e4504 {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:44:55 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Converted 1024.00 MB image at 123.06 MB/s Sep 16 17:44:55 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0f018267-d180-433e-8ccb-601e6a8e4504 is being set with open permissions: ugo+rw: NotImplementedError Sep 16 17:44:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0f018267-d180-433e-8ccb-601e6a8e4504 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:55 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0f018267-d180-433e-8ccb-601e6a8e4504 Sep 16 17:44:55 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:55 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=14,cinder:INSERT=5,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:44:56 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0f018267-d180-433e-8ccb-601e6a8e4504" returned: 0 in 0.334s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Lock "cinder-quobyte-0f018267-d180-433e-8ccb-601e6a8e4504" released by "_copy_volume_from_snapshot" :: held 9.557s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:44:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Acquiring lock "cinder-quobyte-fd0cd663-804f-4042-882d-5de43daff6ce" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:44:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Lock "cinder-quobyte-fd0cd663-804f-4042-882d-5de43daff6ce" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:44:56 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Deleting offline snapshot fd0cd663-804f-4042-882d-5de43daff6ce of volume d53dfdb3-acb1-4209-a1ce-f72ec118caba {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:44:56 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] snapshot_file for this snap is: volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.fd0cd663-804f-4042-882d-5de43daff6ce {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:44:56 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2021ffcb-d8db-48b2-9de7-f798a207c0b8]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:44:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.fd0cd663-804f-4042-882d-5de43daff6ce {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:56 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.fd0cd663-804f-4042-882d-5de43daff6ce Sep 16 17:44:56 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:56 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.fd0cd663-804f-4042-882d-5de43daff6ce" returned: 0 in 0.536s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:56 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:44:56 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8410026-1e79-4a96-8dbf-cc605af58b52]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:44:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:56 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba Sep 16 17:44:56 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:57 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba" returned: 0 in 0.605s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.fd0cd663-804f-4042-882d-5de43daff6ce {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:57 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.fd0cd663-804f-4042-882d-5de43daff6ce Sep 16 17:44:57 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:57 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.fd0cd663-804f-4042-882d-5de43daff6ce" returned: 0 in 0.365s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.fd0cd663-804f-4042-882d-5de43daff6ce {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:57 devstack sudo[96206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.fd0cd663-804f-4042-882d-5de43daff6ce Sep 16 17:44:57 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:58 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:58 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:INSERT=2,cinder:UPDATE=13,cinder:SELECT=11,cinder:DELETE=1 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:44:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba.fd0cd663-804f-4042-882d-5de43daff6ce" returned: 0 in 0.277s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Lock "cinder-quobyte-fd0cd663-804f-4042-882d-5de43daff6ce" released by "_delete_snapshot" :: held 1.985s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:44:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.348s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:44:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.763s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:44:58 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1791636347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb11174c-5094-40ac-ba5d-2e4ef01adc13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddd4bc9fc694decb8c78407aadbbf47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:44:45Z,use_quota=True,user_id='24e26016d4cd4e72a71f07e5a82f3b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:44:58 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Creating volume bb11174c-5094-40ac-ba5d-2e4ef01adc13 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:44:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:44:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:44:58 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:44:58 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:44:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:44:58 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:44:58 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:44:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb11174c-5094-40ac-ba5d-2e4ef01adc13 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:58 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb11174c-5094-40ac-ba5d-2e4ef01adc13 1073741824 Sep 16 17:44:58 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:58 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-073b01d4-7f95-47ee-94a6-1387a07d0731 tempest-GroupsV314Test-1948011877 None] Create group from source-group-651e9f57-1452-41c2-8fe5-ebc3fbf4cdd4 completed successfully. Sep 16 17:44:58 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb11174c-5094-40ac-ba5d-2e4ef01adc13 1073741824" returned: 0 in 0.580s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb11174c-5094-40ac-ba5d-2e4ef01adc13 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:44:58 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb11174c-5094-40ac-ba5d-2e4ef01adc13 Sep 16 17:44:58 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:44:59 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Sep 16 17:44:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb11174c-5094-40ac-ba5d-2e4ef01adc13" returned: 0 in 0.313s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:44:59 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:44:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:44:59 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f070c3c-af4d-4967-bb08-460c3bae91df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb11174c-5094-40ac-ba5d-2e4ef01adc13', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:59 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de1373cc-781e-4d98-a2c6-117078d08584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:44:59 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Volume volume-bb11174c-5094-40ac-ba5d-2e4ef01adc13 (bb11174c-5094-40ac-ba5d-2e4ef01adc13): created successfully Sep 16 17:44:59 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de1373cc-781e-4d98-a2c6-117078d08584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:44:59 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Flow 'volume_create_manager' (433d45b5-8e1c-4c82-9eab-ac69ac16a043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:44:59 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-0f27d356-5525-444e-80ce-56858db91f7c tempest-ProjectReaderTests-1272887064 None] Created volume successfully. Sep 16 17:44:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d1c62f6a-b6a6-461b-8d98-261cf90dd322 tempest-GroupsV314Test-1948011877 None] Acquiring lock "cinder-quobyte-0f018267-d180-433e-8ccb-601e6a8e4504" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:44:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-212e0660-19fb-40c6-b9ea-4ac92516db2a tempest-ProjectReaderTests-1272887064 None] Acquiring lock "cinder-bb11174c-5094-40ac-ba5d-2e4ef01adc13-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:45:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d1c62f6a-b6a6-461b-8d98-261cf90dd322 tempest-GroupsV314Test-1948011877 None] Lock "cinder-quobyte-0f018267-d180-433e-8ccb-601e6a8e4504" acquired by "delete_volume" :: waited 0.088s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:45:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-212e0660-19fb-40c6-b9ea-4ac92516db2a tempest-ProjectReaderTests-1272887064 None] Lock "cinder-bb11174c-5094-40ac-ba5d-2e4ef01adc13-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:45:00 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9a038c-368e-40d0-a7df-409e2603f6fc]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:45:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1c62f6a-b6a6-461b-8d98-261cf90dd322 tempest-GroupsV314Test-1948011877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0f018267-d180-433e-8ccb-601e6a8e4504 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-212e0660-19fb-40c6-b9ea-4ac92516db2a tempest-ProjectReaderTests-1272887064 None] Acquiring lock "cinder-quobyte-bb11174c-5094-40ac-ba5d-2e4ef01adc13" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:45:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-212e0660-19fb-40c6-b9ea-4ac92516db2a tempest-ProjectReaderTests-1272887064 None] Lock "cinder-quobyte-bb11174c-5094-40ac-ba5d-2e4ef01adc13" acquired by "delete_volume" :: waited 0.025s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:45:00 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0787284f-8c82-4728-99ae-4c4c3555a20c]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:45:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-212e0660-19fb-40c6-b9ea-4ac92516db2a tempest-ProjectReaderTests-1272887064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb11174c-5094-40ac-ba5d-2e4ef01adc13 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:00 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0f018267-d180-433e-8ccb-601e6a8e4504 Sep 16 17:45:00 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:00 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb11174c-5094-40ac-ba5d-2e4ef01adc13 Sep 16 17:45:00 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:00 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1c62f6a-b6a6-461b-8d98-261cf90dd322 tempest-GroupsV314Test-1948011877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0f018267-d180-433e-8ccb-601e6a8e4504" returned: 0 in 0.661s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1c62f6a-b6a6-461b-8d98-261cf90dd322 tempest-GroupsV314Test-1948011877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0f018267-d180-433e-8ccb-601e6a8e4504 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:00 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0f018267-d180-433e-8ccb-601e6a8e4504 Sep 16 17:45:00 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:00 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-212e0660-19fb-40c6-b9ea-4ac92516db2a tempest-ProjectReaderTests-1272887064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb11174c-5094-40ac-ba5d-2e4ef01adc13" returned: 0 in 0.593s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-212e0660-19fb-40c6-b9ea-4ac92516db2a tempest-ProjectReaderTests-1272887064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb11174c-5094-40ac-ba5d-2e4ef01adc13 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:00 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb11174c-5094-40ac-ba5d-2e4ef01adc13 Sep 16 17:45:00 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:01 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1c62f6a-b6a6-461b-8d98-261cf90dd322 tempest-GroupsV314Test-1948011877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0f018267-d180-433e-8ccb-601e6a8e4504" returned: 0 in 0.356s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d1c62f6a-b6a6-461b-8d98-261cf90dd322 tempest-GroupsV314Test-1948011877 None] Lock "cinder-quobyte-0f018267-d180-433e-8ccb-601e6a8e4504" released by "delete_volume" :: held 1.126s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:45:01 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-d1c62f6a-b6a6-461b-8d98-261cf90dd322 tempest-GroupsV314Test-1948011877 None] Created reservations ['b6b54936-cf40-4811-9536-654cc19cb0b1'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:45:01 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-212e0660-19fb-40c6-b9ea-4ac92516db2a tempest-ProjectReaderTests-1272887064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb11174c-5094-40ac-ba5d-2e4ef01adc13" returned: 0 in 0.384s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-212e0660-19fb-40c6-b9ea-4ac92516db2a tempest-ProjectReaderTests-1272887064 None] Lock "cinder-quobyte-bb11174c-5094-40ac-ba5d-2e4ef01adc13" released by "delete_volume" :: held 1.071s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:45:01 devstack cinder-volume[85899]: WARNING cinder.quota [None req-d1c62f6a-b6a6-461b-8d98-261cf90dd322 tempest-GroupsV314Test-1948011877 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1439725618 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1439725618, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:45:01 devstack cinder-volume[85899]: WARNING cinder.quota [None req-d1c62f6a-b6a6-461b-8d98-261cf90dd322 tempest-GroupsV314Test-1948011877 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1439725618 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1439725618, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:45:01 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-d1c62f6a-b6a6-461b-8d98-261cf90dd322 tempest-GroupsV314Test-1948011877 None] Created reservations ['423e86aa-f902-4359-845b-49a16ca0433b', 'db1f86b6-f44e-4fff-b79e-abe6a81f05d3', '69911402-804d-4f7f-bd47-2e6d9c0d12b5', '1dcd0845-1bfe-4b33-9810-7bf60e23eec8'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:45:01 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-212e0660-19fb-40c6-b9ea-4ac92516db2a tempest-ProjectReaderTests-1272887064 None] Created reservations ['787d7bbf-13e1-470b-b29c-81fc5862bc6b', '751907fa-4ef5-4daf-aae9-a7ee050b167c', '2b862843-fb94-41a3-a05d-6931239fe121', 'f2efeec4-9b33-4217-98cc-cd4769e868d1'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:45:01 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-55c8cc0e-ee0a-4483-a249-e02a69841df8 req-8335680e-43bf-42a8-b9b7-44aa0492e637 tempest-TestMinimumBasicScenario-141028705 None] Terminate volume connection completed successfully. Sep 16 17:45:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-55c8cc0e-ee0a-4483-a249-e02a69841df8 req-8335680e-43bf-42a8-b9b7-44aa0492e637 tempest-TestMinimumBasicScenario-141028705 None] Deleting attachment 0ce789c7-66f1-4087-8bc7-5d7bc5af86e3. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:45:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-212e0660-19fb-40c6-b9ea-4ac92516db2a tempest-ProjectReaderTests-1272887064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:45:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-212e0660-19fb-40c6-b9ea-4ac92516db2a tempest-ProjectReaderTests-1272887064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:45:01 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-212e0660-19fb-40c6-b9ea-4ac92516db2a tempest-ProjectReaderTests-1272887064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:45:01 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-212e0660-19fb-40c6-b9ea-4ac92516db2a tempest-ProjectReaderTests-1272887064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:45:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-212e0660-19fb-40c6-b9ea-4ac92516db2a tempest-ProjectReaderTests-1272887064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:45:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-212e0660-19fb-40c6-b9ea-4ac92516db2a tempest-ProjectReaderTests-1272887064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d1c62f6a-b6a6-461b-8d98-261cf90dd322 tempest-GroupsV314Test-1948011877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:45:01 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:45:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d1c62f6a-b6a6-461b-8d98-261cf90dd322 tempest-GroupsV314Test-1948011877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:45:01 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d1c62f6a-b6a6-461b-8d98-261cf90dd322 tempest-GroupsV314Test-1948011877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:45:01 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:01 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d1c62f6a-b6a6-461b-8d98-261cf90dd322 tempest-GroupsV314Test-1948011877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:45:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d1c62f6a-b6a6-461b-8d98-261cf90dd322 tempest-GroupsV314Test-1948011877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:45:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1c62f6a-b6a6-461b-8d98-261cf90dd322 tempest-GroupsV314Test-1948011877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:01 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:45:01 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:02 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-212e0660-19fb-40c6-b9ea-4ac92516db2a tempest-ProjectReaderTests-1272887064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.499s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-212e0660-19fb-40c6-b9ea-4ac92516db2a tempest-ProjectReaderTests-1272887064 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:45:02 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-212e0660-19fb-40c6-b9ea-4ac92516db2a tempest-ProjectReaderTests-1272887064 None] Deleted volume successfully. Sep 16 17:45:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-212e0660-19fb-40c6-b9ea-4ac92516db2a tempest-ProjectReaderTests-1272887064 None] Lock "cinder-bb11174c-5094-40ac-ba5d-2e4ef01adc13-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:45:02 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d1c62f6a-b6a6-461b-8d98-261cf90dd322 tempest-GroupsV314Test-1948011877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.525s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:45:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:45:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:45:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:45:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:45:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:45:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-d1c62f6a-b6a6-461b-8d98-261cf90dd322 tempest-GroupsV314Test-1948011877 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:45:02 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-d1c62f6a-b6a6-461b-8d98-261cf90dd322 tempest-GroupsV314Test-1948011877 None] Delete group completed successfully. Sep 16 17:45:02 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:45:02 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0112b3fa-c765-4882-9fbb-60593350b818 tempest-TestMinimumBasicScenario-141028705 None] Acquiring lock "cinder-3ed666e2-427a-4902-878b-1bcdf7a00e4f-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:45:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0112b3fa-c765-4882-9fbb-60593350b818 tempest-TestMinimumBasicScenario-141028705 None] Lock "cinder-3ed666e2-427a-4902-878b-1bcdf7a00e4f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:45:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0112b3fa-c765-4882-9fbb-60593350b818 tempest-TestMinimumBasicScenario-141028705 None] Acquiring lock "cinder-quobyte-3ed666e2-427a-4902-878b-1bcdf7a00e4f" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:45:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0112b3fa-c765-4882-9fbb-60593350b818 tempest-TestMinimumBasicScenario-141028705 None] Lock "cinder-quobyte-3ed666e2-427a-4902-878b-1bcdf7a00e4f" acquired by "delete_volume" :: waited 0.035s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:45:02 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9fd4fd-ab41-4420-a756-0305ab1b000a]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:45:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0112b3fa-c765-4882-9fbb-60593350b818 tempest-TestMinimumBasicScenario-141028705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ed666e2-427a-4902-878b-1bcdf7a00e4f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:02 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.604s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:45:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager._thread_info {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:45:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread count: 28 {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:45:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread info: [<_MainThread(MainThread, started 123748124422272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:45:02 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ed666e2-427a-4902-878b-1bcdf7a00e4f Sep 16 17:45:02 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c0494d1c-81ce-4197-8caf-d13d6c2fdefd tempest-GroupsV314Test-1948011877 None] Acquiring lock "cinder-quobyte-d53dfdb3-acb1-4209-a1ce-f72ec118caba" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c0494d1c-81ce-4197-8caf-d13d6c2fdefd tempest-GroupsV314Test-1948011877 None] Lock "cinder-quobyte-d53dfdb3-acb1-4209-a1ce-f72ec118caba" acquired by "delete_volume" :: waited 0.036s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f3c8e6-ab3f-4c25-ab2b-fec5489ad0bc]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c0494d1c-81ce-4197-8caf-d13d6c2fdefd tempest-GroupsV314Test-1948011877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:03 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:45:03 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba Sep 16 17:45:03 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Flow 'volume_create_manager' (69f4c623-aa2d-483e-b9cf-e9862e53de40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c87481c-dfb6-4041-b3db-f589f9653ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0112b3fa-c765-4882-9fbb-60593350b818 tempest-TestMinimumBasicScenario-141028705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ed666e2-427a-4902-878b-1bcdf7a00e4f" returned: 0 in 0.808s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0112b3fa-c765-4882-9fbb-60593350b818 tempest-TestMinimumBasicScenario-141028705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ed666e2-427a-4902-878b-1bcdf7a00e4f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c87481c-dfb6-4041-b3db-f589f9653ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1839609243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddd4bc9fc694decb8c78407aadbbf47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:45:03Z,use_quota=True,user_id='24e26016d4cd4e72a71f07e5a82f3b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84439f5-e860-4fb6-9986-a0e530a9119e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:45:03 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ed666e2-427a-4902-878b-1bcdf7a00e4f Sep 16 17:45:03 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84439f5-e860-4fb6-9986-a0e530a9119e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e63acf-8c5a-42a3-bd81-4c04a69fddaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e63acf-8c5a-42a3-bd81-4c04a69fddaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb', 'volume_name': 'volume-ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a532370b-d083-4d62-8c70-70750d5d5bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a532370b-d083-4d62-8c70-70750d5d5bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ac580d-7f19-4826-9eb3-5d32ab96d567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:45:03 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Volume ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb', 'volume_size': 1} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1839609243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddd4bc9fc694decb8c78407aadbbf47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:45:03Z,use_quota=True,user_id='24e26016d4cd4e72a71f07e5a82f3b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Creating volume ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:45:03 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:03 devstack sudo[96262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb 1073741824 Sep 16 17:45:03 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:03 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c0494d1c-81ce-4197-8caf-d13d6c2fdefd tempest-GroupsV314Test-1948011877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba" returned: 0 in 0.547s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c0494d1c-81ce-4197-8caf-d13d6c2fdefd tempest-GroupsV314Test-1948011877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:03 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba Sep 16 17:45:03 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:03 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0112b3fa-c765-4882-9fbb-60593350b818 tempest-TestMinimumBasicScenario-141028705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ed666e2-427a-4902-878b-1bcdf7a00e4f" returned: 0 in 0.411s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0112b3fa-c765-4882-9fbb-60593350b818 tempest-TestMinimumBasicScenario-141028705 None] Lock "cinder-quobyte-3ed666e2-427a-4902-878b-1bcdf7a00e4f" released by "delete_volume" :: held 1.298s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-0112b3fa-c765-4882-9fbb-60593350b818 tempest-TestMinimumBasicScenario-141028705 None] Created reservations ['8a9a94ef-848a-4d78-94ed-fac2bfbd0584', '2bfdb8a1-d1a7-494f-9073-fd3aca82babf', '5e8cc9eb-ee41-40a0-a32e-a67a0dc69f6d', 'a39a0b3a-3c7e-4e86-8178-9c5405d5873d'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0112b3fa-c765-4882-9fbb-60593350b818 tempest-TestMinimumBasicScenario-141028705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0112b3fa-c765-4882-9fbb-60593350b818 tempest-TestMinimumBasicScenario-141028705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0112b3fa-c765-4882-9fbb-60593350b818 tempest-TestMinimumBasicScenario-141028705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0112b3fa-c765-4882-9fbb-60593350b818 tempest-TestMinimumBasicScenario-141028705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0112b3fa-c765-4882-9fbb-60593350b818 tempest-TestMinimumBasicScenario-141028705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:45:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0112b3fa-c765-4882-9fbb-60593350b818 tempest-TestMinimumBasicScenario-141028705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:04 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:45:04 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:04 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb 1073741824" returned: 0 in 0.594s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:04 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c0494d1c-81ce-4197-8caf-d13d6c2fdefd tempest-GroupsV314Test-1948011877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d53dfdb3-acb1-4209-a1ce-f72ec118caba" returned: 0 in 0.372s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c0494d1c-81ce-4197-8caf-d13d6c2fdefd tempest-GroupsV314Test-1948011877 None] Lock "cinder-quobyte-d53dfdb3-acb1-4209-a1ce-f72ec118caba" released by "delete_volume" :: held 1.046s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:04 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb Sep 16 17:45:04 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-c0494d1c-81ce-4197-8caf-d13d6c2fdefd tempest-GroupsV314Test-1948011877 None] Created reservations ['e7676671-ff75-4d79-b5e5-065fbff61fc9'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-c0494d1c-81ce-4197-8caf-d13d6c2fdefd tempest-GroupsV314Test-1948011877 None] Created reservations ['c92b91b3-6b85-4fee-a683-dc43b3eb4101', 'e2a7f42f-0123-4fac-8a4f-6e00e285e3a4', 'aa579554-a914-4ed9-9602-d0777498a6ca', '8640f1a9-5fd7-4bc8-a12e-9b2e4426df8f'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:45:04 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0112b3fa-c765-4882-9fbb-60593350b818 tempest-TestMinimumBasicScenario-141028705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.414s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-0112b3fa-c765-4882-9fbb-60593350b818 tempest-TestMinimumBasicScenario-141028705 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c0494d1c-81ce-4197-8caf-d13d6c2fdefd tempest-GroupsV314Test-1948011877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c0494d1c-81ce-4197-8caf-d13d6c2fdefd tempest-GroupsV314Test-1948011877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c0494d1c-81ce-4197-8caf-d13d6c2fdefd tempest-GroupsV314Test-1948011877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c0494d1c-81ce-4197-8caf-d13d6c2fdefd tempest-GroupsV314Test-1948011877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c0494d1c-81ce-4197-8caf-d13d6c2fdefd tempest-GroupsV314Test-1948011877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c0494d1c-81ce-4197-8caf-d13d6c2fdefd tempest-GroupsV314Test-1948011877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:04 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-0112b3fa-c765-4882-9fbb-60593350b818 tempest-TestMinimumBasicScenario-141028705 None] Deleted volume successfully. Sep 16 17:45:04 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:45:04 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0112b3fa-c765-4882-9fbb-60593350b818 tempest-TestMinimumBasicScenario-141028705 None] Lock "cinder-3ed666e2-427a-4902-878b-1bcdf7a00e4f-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:45:04 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb" returned: 0 in 0.369s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ac580d-7f19-4826-9eb3-5d32ab96d567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee24fe8-2009-4852-8edf-40dee58a3410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:45:04 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Volume volume-ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb (ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb): created successfully Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee24fe8-2009-4852-8edf-40dee58a3410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Flow 'volume_create_manager' (69f4c623-aa2d-483e-b9cf-e9862e53de40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:45:04 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-2d4bb3a3-30f0-4984-b98a-07f016b4574f tempest-ProjectReaderTests-1272887064 None] Created volume successfully. Sep 16 17:45:04 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c0494d1c-81ce-4197-8caf-d13d6c2fdefd tempest-GroupsV314Test-1948011877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.301s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:04 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-c0494d1c-81ce-4197-8caf-d13d6c2fdefd tempest-GroupsV314Test-1948011877 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:45:04 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-c0494d1c-81ce-4197-8caf-d13d6c2fdefd tempest-GroupsV314Test-1948011877 None] Delete group completed successfully. Sep 16 17:45:05 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4436795f-c843-4838-931e-3033908cd689 tempest-ProjectReaderTests-1272887064 None] Acquiring lock "cinder-ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:45:05 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4436795f-c843-4838-931e-3033908cd689 tempest-ProjectReaderTests-1272887064 None] Lock "cinder-ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:45:05 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4436795f-c843-4838-931e-3033908cd689 tempest-ProjectReaderTests-1272887064 None] Acquiring lock "cinder-quobyte-ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:45:05 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4436795f-c843-4838-931e-3033908cd689 tempest-ProjectReaderTests-1272887064 None] Lock "cinder-quobyte-ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb" acquired by "delete_volume" :: waited 0.039s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:45:05 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0494accc-fc42-4ad3-809b-333546d9245e]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:45:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4436795f-c843-4838-931e-3033908cd689 tempest-ProjectReaderTests-1272887064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:06 devstack sudo[96308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb Sep 16 17:45:06 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:06 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4436795f-c843-4838-931e-3033908cd689 tempest-ProjectReaderTests-1272887064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb" returned: 0 in 0.726s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4436795f-c843-4838-931e-3033908cd689 tempest-ProjectReaderTests-1272887064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:06 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb Sep 16 17:45:06 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:07 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4436795f-c843-4838-931e-3033908cd689 tempest-ProjectReaderTests-1272887064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb" returned: 0 in 0.492s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:07 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4436795f-c843-4838-931e-3033908cd689 tempest-ProjectReaderTests-1272887064 None] Lock "cinder-quobyte-ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb" released by "delete_volume" :: held 1.395s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:45:07 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-4436795f-c843-4838-931e-3033908cd689 tempest-ProjectReaderTests-1272887064 None] Created reservations ['6f04f7e6-9bce-4442-988a-c77ed89a0dce', '280a0952-5f1f-4b91-91cf-38fd407e445e', '8786c067-2f08-40b2-a608-e94d4dfa85bd', '0e7929b4-cf67-457c-b644-8a4f2495f2b6'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:45:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4436795f-c843-4838-931e-3033908cd689 tempest-ProjectReaderTests-1272887064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:45:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4436795f-c843-4838-931e-3033908cd689 tempest-ProjectReaderTests-1272887064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:45:07 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-4436795f-c843-4838-931e-3033908cd689 tempest-ProjectReaderTests-1272887064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:45:07 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-4436795f-c843-4838-931e-3033908cd689 tempest-ProjectReaderTests-1272887064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:45:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4436795f-c843-4838-931e-3033908cd689 tempest-ProjectReaderTests-1272887064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:45:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4436795f-c843-4838-931e-3033908cd689 tempest-ProjectReaderTests-1272887064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:07 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:45:07 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:07 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4436795f-c843-4838-931e-3033908cd689 tempest-ProjectReaderTests-1272887064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.359s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:07 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-4436795f-c843-4838-931e-3033908cd689 tempest-ProjectReaderTests-1272887064 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:45:07 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-4436795f-c843-4838-931e-3033908cd689 tempest-ProjectReaderTests-1272887064 None] Deleted volume successfully. Sep 16 17:45:07 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4436795f-c843-4838-931e-3033908cd689 tempest-ProjectReaderTests-1272887064 None] Lock "cinder-ea94bc8d-f794-4b22-9fa7-ee1bbb8daadb-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:45:21 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:UPDATE=59,cinder:SELECT=40,cinder:INSERT=14,cinder:DELETE=1 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:45:21 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:UPDATE=50,cinder:SELECT=35,cinder:INSERT=10,cinder:DELETE=4 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:45:53 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:45:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Flow 'volume_create_manager' (9817a7f1-f68d-4b86-a710-94a63314772c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:45:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77abe7a1-731a-4f2b-b4d9-46305c239cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:45:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77abe7a1-731a-4f2b-b4d9-46305c239cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2014517112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7970ee7b-fef3-4905-82d4-2d3d65172876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3ecff0eb09466880ad7ea470eb1f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:45:53Z,use_quota=True,user_id='346f50d4d6e84b6fb5d86d7736e9db60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:45:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c487949-4712-44e1-88ae-f5be5eeaf54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:45:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c487949-4712-44e1-88ae-f5be5eeaf54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:45:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2ea88e-8737-49f5-98a4-f78132d4897c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:45:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2ea88e-8737-49f5-98a4-f78132d4897c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7970ee7b-fef3-4905-82d4-2d3d65172876', 'volume_name': 'volume-7970ee7b-fef3-4905-82d4-2d3d65172876', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:45:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3760bfb3-3fb8-46bb-bdf6-3b7803117f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:45:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3760bfb3-3fb8-46bb-bdf6-3b7803117f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:45:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4dac308-51a9-408c-a74b-b20c1fa64ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:45:53 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Volume 7970ee7b-fef3-4905-82d4-2d3d65172876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7970ee7b-fef3-4905-82d4-2d3d65172876', 'volume_size': 1} Sep 16 17:45:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:45:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:45:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2014517112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7970ee7b-fef3-4905-82d4-2d3d65172876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3ecff0eb09466880ad7ea470eb1f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:45:53Z,use_quota=True,user_id='346f50d4d6e84b6fb5d86d7736e9db60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:45:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Creating volume 7970ee7b-fef3-4905-82d4-2d3d65172876 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:45:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:45:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:45:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:45:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:45:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:45:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:45:53 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:45:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:53 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876 1073741824 Sep 16 17:45:53 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:54 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876 1073741824" returned: 0 in 0.847s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:54 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876 Sep 16 17:45:54 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:55 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876" returned: 0 in 0.510s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:55 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:45:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:45:55 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4dac308-51a9-408c-a74b-b20c1fa64ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7970ee7b-fef3-4905-82d4-2d3d65172876', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:45:55 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c334444-9c41-455d-b43f-ea77191da8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:45:55 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Volume volume-7970ee7b-fef3-4905-82d4-2d3d65172876 (7970ee7b-fef3-4905-82d4-2d3d65172876): created successfully Sep 16 17:45:55 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c334444-9c41-455d-b43f-ea77191da8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:45:55 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Flow 'volume_create_manager' (9817a7f1-f68d-4b86-a710-94a63314772c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:45:55 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-96a85e29-ffce-4c03-93be-c8ae050b08ce tempest-SnapshotDependencyTests-631554845 None] Created volume successfully. Sep 16 17:45:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4b1a03f5-842c-4b76-b86a-3f6abc320beb tempest-SnapshotDependencyTests-631554845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:45:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4b1a03f5-842c-4b76-b86a-3f6abc320beb tempest-SnapshotDependencyTests-631554845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:45:56 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-4b1a03f5-842c-4b76-b86a-3f6abc320beb tempest-SnapshotDependencyTests-631554845 None] Creating offline snapshot 585ee04b-72c6-4b8d-b0a7-4791532f053b of volume 7970ee7b-fef3-4905-82d4-2d3d65172876 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:45:56 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8f2a6b-06ae-4429-9c13-e986d8092d27]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:45:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4b1a03f5-842c-4b76-b86a-3f6abc320beb tempest-SnapshotDependencyTests-631554845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:56 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876 Sep 16 17:45:56 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:56 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4b1a03f5-842c-4b76-b86a-3f6abc320beb tempest-SnapshotDependencyTests-631554845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876" returned: 0 in 0.491s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4b1a03f5-842c-4b76-b86a-3f6abc320beb tempest-SnapshotDependencyTests-631554845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.585ee04b-72c6-4b8d-b0a7-4791532f053b 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:56 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.585ee04b-72c6-4b8d-b0a7-4791532f053b 1G Sep 16 17:45:56 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:57 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4b1a03f5-842c-4b76-b86a-3f6abc320beb tempest-SnapshotDependencyTests-631554845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.585ee04b-72c6-4b8d-b0a7-4791532f053b 1G" returned: 0 in 0.640s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4b1a03f5-842c-4b76-b86a-3f6abc320beb tempest-SnapshotDependencyTests-631554845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7970ee7b-fef3-4905-82d4-2d3d65172876 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.585ee04b-72c6-4b8d-b0a7-4791532f053b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:57 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7970ee7b-fef3-4905-82d4-2d3d65172876 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.585ee04b-72c6-4b8d-b0a7-4791532f053b Sep 16 17:45:57 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:57 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4b1a03f5-842c-4b76-b86a-3f6abc320beb tempest-SnapshotDependencyTests-631554845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7970ee7b-fef3-4905-82d4-2d3d65172876 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.585ee04b-72c6-4b8d-b0a7-4791532f053b" returned: 0 in 0.374s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:57 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-4b1a03f5-842c-4b76-b86a-3f6abc320beb tempest-SnapshotDependencyTests-631554845 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.585ee04b-72c6-4b8d-b0a7-4791532f053b is being set with open permissions: ugo+rw Sep 16 17:45:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4b1a03f5-842c-4b76-b86a-3f6abc320beb tempest-SnapshotDependencyTests-631554845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.585ee04b-72c6-4b8d-b0a7-4791532f053b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:57 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.585ee04b-72c6-4b8d-b0a7-4791532f053b Sep 16 17:45:57 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:57 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4b1a03f5-842c-4b76-b86a-3f6abc320beb tempest-SnapshotDependencyTests-631554845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.585ee04b-72c6-4b8d-b0a7-4791532f053b" returned: 0 in 0.362s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4b1a03f5-842c-4b76-b86a-3f6abc320beb tempest-SnapshotDependencyTests-631554845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:58 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.info Sep 16 17:45:58 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:58 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:45:58 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Flow 'volume_create_manager' (cd613753-313d-4d8e-b96f-4f25b915f41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:45:58 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cec840f-330e-4e52-8984-cadde0c22683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:45:58 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cec840f-330e-4e52-8984-cadde0c22683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2053358241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a4bf357-e9e4-4f5e-a709-c53dcbd1e048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cf2b0ba0ae9475f9b1556bec15284cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:45:58Z,use_quota=True,user_id='b8e19c0117ad48038d590c79741e64db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:45:58 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9cd0b5-46be-4b18-acb5-8662ba862e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:45:58 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9cd0b5-46be-4b18-acb5-8662ba862e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:45:58 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8467a82-1120-4c3b-a20d-63e27d63d9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:45:58 devstack cinder-volume[85899]: DEBUG cinder.image.glance [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Creating Keystone auth plugin from conf {{(pid=85899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 17:45:58 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4b1a03f5-842c-4b76-b86a-3f6abc320beb tempest-SnapshotDependencyTests-631554845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.info" returned: 0 in 0.377s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:58 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-4b1a03f5-842c-4b76-b86a-3f6abc320beb tempest-SnapshotDependencyTests-631554845 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.info is being set with open permissions: ugo+rw Sep 16 17:45:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4b1a03f5-842c-4b76-b86a-3f6abc320beb tempest-SnapshotDependencyTests-631554845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:58 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.info Sep 16 17:45:58 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:58 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8467a82-1120-4c3b-a20d-63e27d63d9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5a4bf357-e9e4-4f5e-a709-c53dcbd1e048', 'volume_name': 'volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048', 'volume_size': 1, 'image_id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '124a9fc6f0b448c1afab7b2b666efe75', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'created_at': datetime.datetime(2026, 9, 16, 15, 30, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 30, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81ac455d-f592-4ef7-8c27-23e4054a633b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:45:58 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc3ebad-6025-4c56-abd6-0fa35562c8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:45:58 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc3ebad-6025-4c56-abd6-0fa35562c8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:45:58 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0169bb1-e2d3-44ea-b5ed-21d9062b5d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:45:58 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Volume 5a4bf357-e9e4-4f5e-a709-c53dcbd1e048: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048', 'volume_size': 1, 'image_id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '124a9fc6f0b448c1afab7b2b666efe75', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'created_at': datetime.datetime(2026, 9, 16, 15, 30, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 30, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81ac455d-f592-4ef7-8c27-23e4054a633b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 17:45:58 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Trying to clone 5a4bf357-e9e4-4f5e-a709-c53dcbd1e048 from image 81ac455d-f592-4ef7-8c27-23e4054a633b at location (None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}]). {{(pid=85899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 17:45:59 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4b1a03f5-842c-4b76-b86a-3f6abc320beb tempest-SnapshotDependencyTests-631554845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.info" returned: 0 in 0.673s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4b1a03f5-842c-4b76-b86a-3f6abc320beb tempest-SnapshotDependencyTests-631554845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.119s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:45:59 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-4b1a03f5-842c-4b76-b86a-3f6abc320beb tempest-SnapshotDependencyTests-631554845 None] Create snapshot completed successfully Sep 16 17:45:59 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_x1o1v3i6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 16 17:45:59 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Image download 20.69 MB at 20.69 MB/s Sep 16 17:45:59 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13b5170-7fd3-419e-8d47-7d75c8ee892f]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:45:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_x1o1v3i6devstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:45:59 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_x1o1v3i6devstack@QuobyteHD Sep 16 17:45:59 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:45:59 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Sep 16 17:45:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_x1o1v3i6devstack@QuobyteHD" returned: 0 in 0.366s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:45:59 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Temporary image 81ac455d-f592-4ef7-8c27-23e4054a633b is fetched for user b8e19c0117ad48038d590c79741e64db. {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 16 17:46:00 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[56066aad-77c3-4c6b-bb83-738c79c79a19]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:46:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_x1o1v3i6devstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:00 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_x1o1v3i6devstack@QuobyteHD Sep 16 17:46:00 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:00 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_x1o1v3i6devstack@QuobyteHD" returned: 0 in 0.511s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2053358241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a4bf357-e9e4-4f5e-a709-c53dcbd1e048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cf2b0ba0ae9475f9b1556bec15284cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:45:58Z,use_quota=True,user_id='b8e19c0117ad48038d590c79741e64db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:46:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Creating volume 5a4bf357-e9e4-4f5e-a709-c53dcbd1e048 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:46:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:46:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:46:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:46:00 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:46:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:00 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048 1073741824 Sep 16 17:46:00 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Flow 'volume_create_manager' (75914e98-46b4-4e1a-82e6-e917afa5c665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fa201cd-9505-4529-8b4a-072ed66b326a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:01 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fa201cd-9505-4529-8b4a-072ed66b326a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=353bb518-7bca-4364-a2e0-6f7d7dae3312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3ecff0eb09466880ad7ea470eb1f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=585ee04b-72c6-4b8d-b0a7-4791532f053b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:46:01Z,use_quota=True,user_id='346f50d4d6e84b6fb5d86d7736e9db60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc5e5ce-50f1-4f7e-ba71-82ade585cc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc5e5ce-50f1-4f7e-ba71-82ade585cc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be27a86-6801-466a-849a-2852e89a8fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be27a86-6801-466a-849a-2852e89a8fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '353bb518-7bca-4364-a2e0-6f7d7dae3312', 'volume_name': 'volume-353bb518-7bca-4364-a2e0-6f7d7dae3312', 'volume_size': 1, 'snapshot_id': '585ee04b-72c6-4b8d-b0a7-4791532f053b'}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ba9b43-f962-49ae-9552-586f37c32e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ba9b43-f962-49ae-9552-586f37c32e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a4a0ce-4785-44ce-8552-87ee56bc4e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:01 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Volume 353bb518-7bca-4364-a2e0-6f7d7dae3312: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-353bb518-7bca-4364-a2e0-6f7d7dae3312', 'volume_size': 1, 'snapshot_id': '585ee04b-72c6-4b8d-b0a7-4791532f053b'} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048 1073741824" returned: 0 in 0.944s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:01 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048 Sep 16 17:46:01 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:01 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048" returned: 0 in 0.271s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.310s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Acquiring lock "cinder-quobyte-585ee04b-72c6-4b8d-b0a7-4791532f053b-353bb518-7bca-4364-a2e0-6f7d7dae3312" by "_create_volume_from_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Lock "cinder-quobyte-585ee04b-72c6-4b8d-b0a7-4791532f053b-353bb518-7bca-4364-a2e0-6f7d7dae3312" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Creating volume 353bb518-7bca-4364-a2e0-6f7d7dae3312 from snapshot 585ee04b-72c6-4b8d-b0a7-4791532f053b {{(pid=85899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Acquiring lock "cinder-quobyte-353bb518-7bca-4364-a2e0-6f7d7dae3312" by "_copy_volume_from_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Attempting download of 81ac455d-f592-4ef7-8c27-23e4054a633b ((None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}])) to volume 5a4bf357-e9e4-4f5e-a709-c53dcbd1e048. {{(pid=85899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Lock "cinder-quobyte-353bb518-7bca-4364-a2e0-6f7d7dae3312" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:46:01 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] snapshot: 585ee04b-72c6-4b8d-b0a7-4791532f053b, volume: 353bb518-7bca-4364-a2e0-6f7d7dae3312, {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 17:46:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:46:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:46:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:02 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb6e156-7120-4010-952b-c4378fa08adc]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:46:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.585ee04b-72c6-4b8d-b0a7-4791532f053b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:02 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f5f3a8-f346-42ff-86e5-a72f09e94dc0]: (4, 'raw') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:46:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_36t37lxo {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:46:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:46:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:46:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:02 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_36t37lxo Sep 16 17:46:02 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:02 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:46:02 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:02 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.585ee04b-72c6-4b8d-b0a7-4791532f053b Sep 16 17:46:02 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:02 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_36t37lxo" returned: 0 in 0.602s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_36t37lxo {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:02 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.625s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:46:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager._thread_info {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:46:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread count: 28 {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:46:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread info: [<_MainThread(MainThread, started 123748124422272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:46:02 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_36t37lxo Sep 16 17:46:02 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:03 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.585ee04b-72c6-4b8d-b0a7-4791532f053b" returned: 0 in 1.043s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7970ee7b-fef3-4905-82d4-2d3d65172876(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:46:03 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03ebdd2-3ec9-4f0e-87df-4e3843cfcc5b]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:46:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:03 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_36t37lxo" returned: 1 in 0.584s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_36t37lxo' failed. Not Retrying. {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:46:03 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a354ab-e927-44bf-b082-c4108f65d3c9]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:46:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_x1o1v3i6devstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:03 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876 Sep 16 17:46:03 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:03 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_x1o1v3i6devstack@QuobyteHD Sep 16 17:46:03 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:03 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876" returned: 0 in 0.726s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876 {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 17:46:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Creating direct copy from snapshot {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 17:46:03 devstack cinder-volume[85899]: DEBUG cinder.utils [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Path /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-353bb518-7bca-4364-a2e0-6f7d7dae3312 not found in is_blk_device check {{(pid=85899) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 17:46:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-353bb518-7bca-4364-a2e0-6f7d7dae3312 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:03 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_x1o1v3i6devstack@QuobyteHD" returned: 0 in 0.626s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:03 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] 81ac455d-f592-4ef7-8c27-23e4054a633b was qcow2, converting to qcow2 {{(pid=85899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 16 17:46:03 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-353bb518-7bca-4364-a2e0-6f7d7dae3312 Sep 16 17:46:03 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_x1o1v3i6devstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:03 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_x1o1v3i6devstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048 Sep 16 17:46:03 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:09 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_x1o1v3i6devstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048" returned: 0 in 5.670s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:09 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_x1o1v3i6devstack@QuobyteHD, size 112.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048 {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:46:09 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Converted 112.00 MB image at 19.74 MB/s Sep 16 17:46:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:09 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048 1G Sep 16 17:46:09 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:10 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048 1G" returned: 0 in 0.783s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:10 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Downloaded image 81ac455d-f592-4ef7-8c27-23e4054a633b ((None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}])) to volume 5a4bf357-e9e4-4f5e-a709-c53dcbd1e048 successfully. {{(pid=85899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 17:46:10 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Temporary image 81ac455d-f592-4ef7-8c27-23e4054a633b for user b8e19c0117ad48038d590c79741e64db is deleted. {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 16 17:46:10 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Marking volume 5a4bf357-e9e4-4f5e-a709-c53dcbd1e048 as bootable. {{(pid=85899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 17:46:10 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Copying metadata from image 81ac455d-f592-4ef7-8c27-23e4054a633b to 5a4bf357-e9e4-4f5e-a709-c53dcbd1e048. {{(pid=85899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 17:46:10 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Creating volume glance metadata for volume 5a4bf357-e9e4-4f5e-a709-c53dcbd1e048 backed by image 81ac455d-f592-4ef7-8c27-23e4054a633b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 17:46:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0169bb1-e2d3-44ea-b5ed-21d9062b5d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048', 'volume_size': 1, 'image_id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '124a9fc6f0b448c1afab7b2b666efe75', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'created_at': datetime.datetime(2026, 9, 16, 15, 30, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 30, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81ac455d-f592-4ef7-8c27-23e4054a633b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db75c6ac-e0b9-4ab3-bc94-b89f09a330f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:10 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Volume volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048 (5a4bf357-e9e4-4f5e-a709-c53dcbd1e048): created successfully Sep 16 17:46:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db75c6ac-e0b9-4ab3-bc94-b89f09a330f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Flow 'volume_create_manager' (cd613753-313d-4d8e-b96f-4f25b915f41f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:46:10 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-ad2a6d29-b816-4eeb-9a11-ea604ec5bd9e tempest-TestShelveInstance-484011381 None] Created volume successfully. Sep 16 17:46:13 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-353bb518-7bca-4364-a2e0-6f7d7dae3312" returned: 0 in 9.878s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:13 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Image conversion details: src /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876, size 1024.00 MB, duration 9.88 sec, destination /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-353bb518-7bca-4364-a2e0-6f7d7dae3312 {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:46:13 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Converted 1024.00 MB image at 103.65 MB/s Sep 16 17:46:13 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-353bb518-7bca-4364-a2e0-6f7d7dae3312 is being set with open permissions: ugo+rw Sep 16 17:46:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-353bb518-7bca-4364-a2e0-6f7d7dae3312 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:13 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-353bb518-7bca-4364-a2e0-6f7d7dae3312 Sep 16 17:46:13 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:14 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-353bb518-7bca-4364-a2e0-6f7d7dae3312" returned: 0 in 0.312s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:14 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Lock "cinder-quobyte-353bb518-7bca-4364-a2e0-6f7d7dae3312" released by "_copy_volume_from_snapshot" :: held 12.122s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:46:14 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Lock "cinder-quobyte-585ee04b-72c6-4b8d-b0a7-4791532f053b-353bb518-7bca-4364-a2e0-6f7d7dae3312" released by "_create_volume_from_snapshot" :: held 12.265s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:46:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.297s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a4a0ce-4785-44ce-8552-87ee56bc4e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-353bb518-7bca-4364-a2e0-6f7d7dae3312', 'volume_size': 1, 'snapshot_id': '585ee04b-72c6-4b8d-b0a7-4791532f053b'}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fad81b7-475b-4db4-835f-67b67534b6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:14 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Volume volume-353bb518-7bca-4364-a2e0-6f7d7dae3312 (353bb518-7bca-4364-a2e0-6f7d7dae3312): created successfully Sep 16 17:46:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fad81b7-475b-4db4-835f-67b67534b6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Flow 'volume_create_manager' (75914e98-46b4-4e1a-82e6-e917afa5c665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:46:14 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-30ab1559-65e8-4209-9514-30ca5238425f tempest-SnapshotDependencyTests-631554845 None] Created volume successfully. Sep 16 17:46:15 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2a9af720-d10f-471e-95af-a0a52952bb09 tempest-SnapshotDependencyTests-631554845 None] Acquiring lock "cinder-585ee04b-72c6-4b8d-b0a7-4791532f053b-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:46:15 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2a9af720-d10f-471e-95af-a0a52952bb09 tempest-SnapshotDependencyTests-631554845 None] Lock "cinder-585ee04b-72c6-4b8d-b0a7-4791532f053b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:46:15 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2a9af720-d10f-471e-95af-a0a52952bb09 tempest-SnapshotDependencyTests-631554845 None] Acquiring lock "cinder-quobyte-7970ee7b-fef3-4905-82d4-2d3d65172876" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:46:15 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2a9af720-d10f-471e-95af-a0a52952bb09 tempest-SnapshotDependencyTests-631554845 None] Lock "cinder-quobyte-7970ee7b-fef3-4905-82d4-2d3d65172876" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:46:15 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2a9af720-d10f-471e-95af-a0a52952bb09 tempest-SnapshotDependencyTests-631554845 None] Acquiring lock "cinder-quobyte-585ee04b-72c6-4b8d-b0a7-4791532f053b" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:46:15 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2a9af720-d10f-471e-95af-a0a52952bb09 tempest-SnapshotDependencyTests-631554845 None] Lock "cinder-quobyte-585ee04b-72c6-4b8d-b0a7-4791532f053b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:46:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-2a9af720-d10f-471e-95af-a0a52952bb09 tempest-SnapshotDependencyTests-631554845 None] Deleting offline snapshot 585ee04b-72c6-4b8d-b0a7-4791532f053b of volume 7970ee7b-fef3-4905-82d4-2d3d65172876 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:46:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-2a9af720-d10f-471e-95af-a0a52952bb09 tempest-SnapshotDependencyTests-631554845 None] snapshot_file for this snap is: volume-7970ee7b-fef3-4905-82d4-2d3d65172876.585ee04b-72c6-4b8d-b0a7-4791532f053b {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:46:15 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a913c48-eaee-47be-bda1-c5d4ae68e369]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:46:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2a9af720-d10f-471e-95af-a0a52952bb09 tempest-SnapshotDependencyTests-631554845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.585ee04b-72c6-4b8d-b0a7-4791532f053b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:15 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.585ee04b-72c6-4b8d-b0a7-4791532f053b Sep 16 17:46:15 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:15 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2a9af720-d10f-471e-95af-a0a52952bb09 tempest-SnapshotDependencyTests-631554845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.585ee04b-72c6-4b8d-b0a7-4791532f053b" returned: 0 in 0.664s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-2a9af720-d10f-471e-95af-a0a52952bb09 tempest-SnapshotDependencyTests-631554845 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7970ee7b-fef3-4905-82d4-2d3d65172876(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:46:15 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[24875050-03af-48a8-9a08-66f7e1831c18]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:46:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2a9af720-d10f-471e-95af-a0a52952bb09 tempest-SnapshotDependencyTests-631554845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:16 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876 Sep 16 17:46:16 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-fc868bbe-f106-4d21-b6ad-7d34922d00c8 req-c94eb8ec-98c3-43ef-ab92-25a6496e259b tempest-TestShelveInstance-484011381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-fc868bbe-f106-4d21-b6ad-7d34922d00c8 req-c94eb8ec-98c3-43ef-ab92-25a6496e259b tempest-TestShelveInstance-484011381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-fc868bbe-f106-4d21-b6ad-7d34922d00c8 req-c94eb8ec-98c3-43ef-ab92-25a6496e259b tempest-TestShelveInstance-484011381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-fc868bbe-f106-4d21-b6ad-7d34922d00c8 req-c94eb8ec-98c3-43ef-ab92-25a6496e259b tempest-TestShelveInstance-484011381 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7', 'name': 'volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a3b7bff-d29a-4b5d-b8f1-4de2ecd57949', 'enforce_multipath': True} {{(pid=85899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4920}} Sep 16 17:46:16 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-fc868bbe-f106-4d21-b6ad-7d34922d00c8 req-c94eb8ec-98c3-43ef-ab92-25a6496e259b tempest-TestShelveInstance-484011381 None] attachment_update completed successfully. Sep 16 17:46:16 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2a9af720-d10f-471e-95af-a0a52952bb09 tempest-SnapshotDependencyTests-631554845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876" returned: 0 in 0.801s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2a9af720-d10f-471e-95af-a0a52952bb09 tempest-SnapshotDependencyTests-631554845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.585ee04b-72c6-4b8d-b0a7-4791532f053b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:16 devstack sudo[96681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.585ee04b-72c6-4b8d-b0a7-4791532f053b Sep 16 17:46:16 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:17 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2a9af720-d10f-471e-95af-a0a52952bb09 tempest-SnapshotDependencyTests-631554845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.585ee04b-72c6-4b8d-b0a7-4791532f053b" returned: 0 in 0.544s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2a9af720-d10f-471e-95af-a0a52952bb09 tempest-SnapshotDependencyTests-631554845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.585ee04b-72c6-4b8d-b0a7-4791532f053b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:17 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.585ee04b-72c6-4b8d-b0a7-4791532f053b Sep 16 17:46:17 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:17 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2a9af720-d10f-471e-95af-a0a52952bb09 tempest-SnapshotDependencyTests-631554845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876.585ee04b-72c6-4b8d-b0a7-4791532f053b" returned: 0 in 0.280s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2a9af720-d10f-471e-95af-a0a52952bb09 tempest-SnapshotDependencyTests-631554845 None] Lock "cinder-quobyte-585ee04b-72c6-4b8d-b0a7-4791532f053b" released by "_delete_snapshot" :: held 2.427s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:46:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2a9af720-d10f-471e-95af-a0a52952bb09 tempest-SnapshotDependencyTests-631554845 None] Lock "cinder-quobyte-7970ee7b-fef3-4905-82d4-2d3d65172876" released by "delete_snapshot" :: held 2.456s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:46:17 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-2a9af720-d10f-471e-95af-a0a52952bb09 tempest-SnapshotDependencyTests-631554845 None] Created reservations ['8d273239-311f-46f8-a7ca-0a763499d9da', '8aeb450d-a737-448c-8d79-7335ff9af72c', '4e698621-46ef-436a-b245-6d758c85fe00', 'd5490608-833d-44e4-914b-777e4181ba6b'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:46:17 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-2a9af720-d10f-471e-95af-a0a52952bb09 tempest-SnapshotDependencyTests-631554845 None] Delete snapshot completed successfully. Sep 16 17:46:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2a9af720-d10f-471e-95af-a0a52952bb09 tempest-SnapshotDependencyTests-631554845 None] Lock "cinder-585ee04b-72c6-4b8d-b0a7-4791532f053b-delete_snapshot" released by "delete_snapshot" :: held 2.655s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:46:18 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4db83c31-5232-4cae-9231-ecb24a4d62ba tempest-SnapshotDependencyTests-631554845 None] Acquiring lock "cinder-7970ee7b-fef3-4905-82d4-2d3d65172876-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:46:18 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4db83c31-5232-4cae-9231-ecb24a4d62ba tempest-SnapshotDependencyTests-631554845 None] Lock "cinder-7970ee7b-fef3-4905-82d4-2d3d65172876-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:46:18 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4db83c31-5232-4cae-9231-ecb24a4d62ba tempest-SnapshotDependencyTests-631554845 None] Acquiring lock "cinder-quobyte-7970ee7b-fef3-4905-82d4-2d3d65172876" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:46:18 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4db83c31-5232-4cae-9231-ecb24a4d62ba tempest-SnapshotDependencyTests-631554845 None] Lock "cinder-quobyte-7970ee7b-fef3-4905-82d4-2d3d65172876" acquired by "delete_volume" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:46:18 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ac0b83-e92d-4228-bb6d-5994caf3e5ea]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:46:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4db83c31-5232-4cae-9231-ecb24a4d62ba tempest-SnapshotDependencyTests-631554845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:18 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876 Sep 16 17:46:18 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:19 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4db83c31-5232-4cae-9231-ecb24a4d62ba tempest-SnapshotDependencyTests-631554845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876" returned: 0 in 0.554s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4db83c31-5232-4cae-9231-ecb24a4d62ba tempest-SnapshotDependencyTests-631554845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:19 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876 Sep 16 17:46:19 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:19 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4db83c31-5232-4cae-9231-ecb24a4d62ba tempest-SnapshotDependencyTests-631554845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7970ee7b-fef3-4905-82d4-2d3d65172876" returned: 0 in 0.382s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:19 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4db83c31-5232-4cae-9231-ecb24a4d62ba tempest-SnapshotDependencyTests-631554845 None] Lock "cinder-quobyte-7970ee7b-fef3-4905-82d4-2d3d65172876" released by "delete_volume" :: held 1.081s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:46:19 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-4db83c31-5232-4cae-9231-ecb24a4d62ba tempest-SnapshotDependencyTests-631554845 None] Created reservations ['dee19512-c4a2-4d62-9124-780a679e4c78', 'f7ef040d-5838-4e44-b8c2-9015d18ae9be', '27e62949-eed5-40b6-bb15-0637f75add56', '92cdc8e2-f16d-4659-9b65-fd0b02c644e6'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:46:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4db83c31-5232-4cae-9231-ecb24a4d62ba tempest-SnapshotDependencyTests-631554845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4db83c31-5232-4cae-9231-ecb24a4d62ba tempest-SnapshotDependencyTests-631554845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-4db83c31-5232-4cae-9231-ecb24a4d62ba tempest-SnapshotDependencyTests-631554845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:46:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-4db83c31-5232-4cae-9231-ecb24a4d62ba tempest-SnapshotDependencyTests-631554845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:46:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4db83c31-5232-4cae-9231-ecb24a4d62ba tempest-SnapshotDependencyTests-631554845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4db83c31-5232-4cae-9231-ecb24a4d62ba tempest-SnapshotDependencyTests-631554845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:20 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:46:20 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:20 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:46:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Flow 'volume_create_manager' (6865603d-2059-4b0c-a088-a5426c46632f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:46:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5e4179-e2ef-4b84-ba65-899bd1088df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5e4179-e2ef-4b84-ba65-899bd1088df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1267952732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfad796b-826a-4ad8-af18-5f41f56689e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e7be8220d214028bee3b3d0d1541d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:46:20Z,use_quota=True,user_id='2200e0e18b4a46cdbfe6ee8c15ff8832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024e287b-9508-44dd-920b-789ac707dcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024e287b-9508-44dd-920b-789ac707dcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa3fb527-2d1b-4169-850c-dc31bd29a8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:20 devstack cinder-volume[85899]: DEBUG cinder.image.glance [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Creating Keystone auth plugin from conf {{(pid=85899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 17:46:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-66848f6b-8f2a-4468-8343-62bc8091401a tempest-SnapshotDependencyTests-631554845 None] Acquiring lock "cinder-353bb518-7bca-4364-a2e0-6f7d7dae3312-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:46:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-66848f6b-8f2a-4468-8343-62bc8091401a tempest-SnapshotDependencyTests-631554845 None] Lock "cinder-353bb518-7bca-4364-a2e0-6f7d7dae3312-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:46:20 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4db83c31-5232-4cae-9231-ecb24a4d62ba tempest-SnapshotDependencyTests-631554845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.863s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:20 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-4db83c31-5232-4cae-9231-ecb24a4d62ba tempest-SnapshotDependencyTests-631554845 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:46:20 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-4db83c31-5232-4cae-9231-ecb24a4d62ba tempest-SnapshotDependencyTests-631554845 None] Deleted volume successfully. Sep 16 17:46:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-66848f6b-8f2a-4468-8343-62bc8091401a tempest-SnapshotDependencyTests-631554845 None] Acquiring lock "cinder-quobyte-353bb518-7bca-4364-a2e0-6f7d7dae3312" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:46:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-66848f6b-8f2a-4468-8343-62bc8091401a tempest-SnapshotDependencyTests-631554845 None] Lock "cinder-quobyte-353bb518-7bca-4364-a2e0-6f7d7dae3312" acquired by "delete_volume" :: waited 0.033s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:46:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4db83c31-5232-4cae-9231-ecb24a4d62ba tempest-SnapshotDependencyTests-631554845 None] Lock "cinder-7970ee7b-fef3-4905-82d4-2d3d65172876-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:46:21 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[239a30ac-7804-433c-9f10-29432328f4f1]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:46:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-66848f6b-8f2a-4468-8343-62bc8091401a tempest-SnapshotDependencyTests-631554845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-353bb518-7bca-4364-a2e0-6f7d7dae3312 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:21 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-353bb518-7bca-4364-a2e0-6f7d7dae3312 Sep 16 17:46:21 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa3fb527-2d1b-4169-850c-dc31bd29a8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dfad796b-826a-4ad8-af18-5f41f56689e6', 'volume_name': 'volume-dfad796b-826a-4ad8-af18-5f41f56689e6', 'volume_size': 1, 'image_id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '124a9fc6f0b448c1afab7b2b666efe75', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'created_at': datetime.datetime(2026, 9, 16, 15, 30, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 30, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81ac455d-f592-4ef7-8c27-23e4054a633b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636893da-f991-4fa8-8610-a821880e39b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636893da-f991-4fa8-8610-a821880e39b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eac3b6c-2703-435f-8daf-9febb0054aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:21 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Volume dfad796b-826a-4ad8-af18-5f41f56689e6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dfad796b-826a-4ad8-af18-5f41f56689e6', 'volume_size': 1, 'image_id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '124a9fc6f0b448c1afab7b2b666efe75', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'created_at': datetime.datetime(2026, 9, 16, 15, 30, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 30, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81ac455d-f592-4ef7-8c27-23e4054a633b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 17:46:21 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Trying to clone dfad796b-826a-4ad8-af18-5f41f56689e6 from image 81ac455d-f592-4ef7-8c27-23e4054a633b at location (None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}]). {{(pid=85899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 17:46:21 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-66848f6b-8f2a-4468-8343-62bc8091401a tempest-SnapshotDependencyTests-631554845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-353bb518-7bca-4364-a2e0-6f7d7dae3312" returned: 0 in 0.643s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-66848f6b-8f2a-4468-8343-62bc8091401a tempest-SnapshotDependencyTests-631554845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-353bb518-7bca-4364-a2e0-6f7d7dae3312 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:21 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-353bb518-7bca-4364-a2e0-6f7d7dae3312 Sep 16 17:46:21 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:21 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_udnrkgssdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 16 17:46:21 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Image download 20.69 MB at 20.69 MB/s Sep 16 17:46:21 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b4b8cb-0240-4743-9888-22eeae02c0fa]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:46:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_udnrkgssdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:21 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_udnrkgssdevstack@QuobyteHD Sep 16 17:46:21 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:22 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-66848f6b-8f2a-4468-8343-62bc8091401a tempest-SnapshotDependencyTests-631554845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-353bb518-7bca-4364-a2e0-6f7d7dae3312" returned: 0 in 0.309s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-66848f6b-8f2a-4468-8343-62bc8091401a tempest-SnapshotDependencyTests-631554845 None] Lock "cinder-quobyte-353bb518-7bca-4364-a2e0-6f7d7dae3312" released by "delete_volume" :: held 1.038s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-66848f6b-8f2a-4468-8343-62bc8091401a tempest-SnapshotDependencyTests-631554845 None] Created reservations ['13f9972d-d26d-4adc-ad13-8aefe9d6d1ac', '9867677b-4a68-4770-aa88-a646a8b2b482', 'f080357e-2a0c-432d-974b-4347e1a86b6c', '86bf7abb-a628-42f8-8fa4-a521c70fb8ec'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-66848f6b-8f2a-4468-8343-62bc8091401a tempest-SnapshotDependencyTests-631554845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-66848f6b-8f2a-4468-8343-62bc8091401a tempest-SnapshotDependencyTests-631554845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-66848f6b-8f2a-4468-8343-62bc8091401a tempest-SnapshotDependencyTests-631554845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-66848f6b-8f2a-4468-8343-62bc8091401a tempest-SnapshotDependencyTests-631554845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-66848f6b-8f2a-4468-8343-62bc8091401a tempest-SnapshotDependencyTests-631554845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-66848f6b-8f2a-4468-8343-62bc8091401a tempest-SnapshotDependencyTests-631554845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:22 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:46:22 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:22 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_udnrkgssdevstack@QuobyteHD" returned: 0 in 0.477s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Temporary image 81ac455d-f592-4ef7-8c27-23e4054a633b is fetched for user 2200e0e18b4a46cdbfe6ee8c15ff8832. {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94a2dc3-d599-45b7-afad-25e5e0febd98]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_udnrkgssdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:22 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-66848f6b-8f2a-4468-8343-62bc8091401a tempest-SnapshotDependencyTests-631554845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.379s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:22 devstack sudo[97198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_udnrkgssdevstack@QuobyteHD Sep 16 17:46:22 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-66848f6b-8f2a-4468-8343-62bc8091401a tempest-SnapshotDependencyTests-631554845 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:46:22 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-66848f6b-8f2a-4468-8343-62bc8091401a tempest-SnapshotDependencyTests-631554845 None] Deleted volume successfully. Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-66848f6b-8f2a-4468-8343-62bc8091401a tempest-SnapshotDependencyTests-631554845 None] Lock "cinder-353bb518-7bca-4364-a2e0-6f7d7dae3312-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:46:22 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_udnrkgssdevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1267952732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfad796b-826a-4ad8-af18-5f41f56689e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e7be8220d214028bee3b3d0d1541d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:46:20Z,use_quota=True,user_id='2200e0e18b4a46cdbfe6ee8c15ff8832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Creating volume dfad796b-826a-4ad8-af18-5f41f56689e6 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:46:22 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:46:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dfad796b-826a-4ad8-af18-5f41f56689e6 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:22 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dfad796b-826a-4ad8-af18-5f41f56689e6 1073741824 Sep 16 17:46:22 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:23 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dfad796b-826a-4ad8-af18-5f41f56689e6 1073741824" returned: 0 in 0.793s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dfad796b-826a-4ad8-af18-5f41f56689e6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:23 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dfad796b-826a-4ad8-af18-5f41f56689e6 Sep 16 17:46:23 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Flow 'volume_create_manager' (94efea43-e9f1-4647-9f85-ad7026ba6d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e508f75b-97c4-479d-be3c-dd3cbbf72129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e508f75b-97c4-479d-be3c-dd3cbbf72129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-822941584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fa19975-d25b-4188-8285-f0b8a01895a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8faf4d833a5b4e9baaa017bd8d4af3b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:46:24Z,use_quota=True,user_id='7439398770884a3388e997e284b23644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2dfd903-4bc1-43e8-9907-9cadf242cced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2dfd903-4bc1-43e8-9907-9cadf242cced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949e348e-4e02-4fa1-9a89-40500b53b7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949e348e-4e02-4fa1-9a89-40500b53b7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fa19975-d25b-4188-8285-f0b8a01895a2', 'volume_name': 'volume-4fa19975-d25b-4188-8285-f0b8a01895a2', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d587989c-083f-4cfb-b6a0-56107dac8323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:24 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d587989c-083f-4cfb-b6a0-56107dac8323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16563e2b-8e17-4515-9533-abb269e98e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:24 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Volume 4fa19975-d25b-4188-8285-f0b8a01895a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fa19975-d25b-4188-8285-f0b8a01895a2', 'volume_size': 1} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dfad796b-826a-4ad8-af18-5f41f56689e6" returned: 0 in 0.471s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-822941584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fa19975-d25b-4188-8285-f0b8a01895a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8faf4d833a5b4e9baaa017bd8d4af3b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:46:24Z,use_quota=True,user_id='7439398770884a3388e997e284b23644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Creating volume 4fa19975-d25b-4188-8285-f0b8a01895a2 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:46:24 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4fa19975-d25b-4188-8285-f0b8a01895a2 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Attempting download of 81ac455d-f592-4ef7-8c27-23e4054a633b ((None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}])) to volume dfad796b-826a-4ad8-af18-5f41f56689e6. {{(pid=85899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 17:46:24 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4fa19975-d25b-4188-8285-f0b8a01895a2 1073741824 Sep 16 17:46:24 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[694d1132-24d7-455f-81aa-d2edd94a6061]: (4, 'raw') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:46:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_vt4xa_le {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:24 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_vt4xa_le Sep 16 17:46:24 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:25 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_vt4xa_le" returned: 0 in 0.628s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_vt4xa_le {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:25 devstack sudo[97223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_vt4xa_le Sep 16 17:46:25 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:25 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4fa19975-d25b-4188-8285-f0b8a01895a2 1073741824" returned: 0 in 1.073s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4fa19975-d25b-4188-8285-f0b8a01895a2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:25 devstack sudo[97225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4fa19975-d25b-4188-8285-f0b8a01895a2 Sep 16 17:46:25 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:25 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_vt4xa_le" returned: 1 in 0.526s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_vt4xa_le' failed. Not Retrying. {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:46:25 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0924e41b-8e4e-4d70-b3b0-5beee3481ffd]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:46:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_udnrkgssdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:25 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_udnrkgssdevstack@QuobyteHD Sep 16 17:46:25 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:25 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4fa19975-d25b-4188-8285-f0b8a01895a2" returned: 0 in 0.470s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:46:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:25 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16563e2b-8e17-4515-9533-abb269e98e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fa19975-d25b-4188-8285-f0b8a01895a2', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:25 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ccbb469-380b-430d-bff3-3150da121a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:26 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Volume volume-4fa19975-d25b-4188-8285-f0b8a01895a2 (4fa19975-d25b-4188-8285-f0b8a01895a2): created successfully Sep 16 17:46:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ccbb469-380b-430d-bff3-3150da121a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Flow 'volume_create_manager' (94efea43-e9f1-4647-9f85-ad7026ba6d32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:46:26 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-dcc91a71-e9df-4aa9-b441-330e34a73a28 tempest-AttachVolumeTestJSON-115136149 None] Created volume successfully. Sep 16 17:46:26 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_udnrkgssdevstack@QuobyteHD" returned: 0 in 0.536s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:26 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] 81ac455d-f592-4ef7-8c27-23e4054a633b was qcow2, converting to qcow2 {{(pid=85899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 16 17:46:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_udnrkgssdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dfad796b-826a-4ad8-af18-5f41f56689e6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:26 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_udnrkgssdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dfad796b-826a-4ad8-af18-5f41f56689e6 Sep 16 17:46:26 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-56764002-bbce-49aa-af1a-bd3cf49fdb91 req-4b42cac1-ca49-4f76-8778-db136599f2b4 tempest-AttachVolumeTestJSON-115136149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-56764002-bbce-49aa-af1a-bd3cf49fdb91 req-4b42cac1-ca49-4f76-8778-db136599f2b4 tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-56764002-bbce-49aa-af1a-bd3cf49fdb91 req-4b42cac1-ca49-4f76-8778-db136599f2b4 tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-56764002-bbce-49aa-af1a-bd3cf49fdb91 req-4b42cac1-ca49-4f76-8778-db136599f2b4 tempest-AttachVolumeTestJSON-115136149 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7', 'name': 'volume-4fa19975-d25b-4188-8285-f0b8a01895a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06360167-aa60-45f2-9673-af4c5da9a89e', 'enforce_multipath': True} {{(pid=85899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4920}} Sep 16 17:46:28 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-56764002-bbce-49aa-af1a-bd3cf49fdb91 req-4b42cac1-ca49-4f76-8778-db136599f2b4 tempest-AttachVolumeTestJSON-115136149 None] attachment_update completed successfully. Sep 16 17:46:29 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_udnrkgssdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dfad796b-826a-4ad8-af18-5f41f56689e6" returned: 0 in 3.212s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:29 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_udnrkgssdevstack@QuobyteHD, size 112.00 MB, duration 3.21 sec, destination /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dfad796b-826a-4ad8-af18-5f41f56689e6 {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:46:29 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Converted 112.00 MB image at 34.86 MB/s Sep 16 17:46:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dfad796b-826a-4ad8-af18-5f41f56689e6 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:29 devstack sudo[97261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dfad796b-826a-4ad8-af18-5f41f56689e6 1G Sep 16 17:46:29 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:29 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dfad796b-826a-4ad8-af18-5f41f56689e6 1G" returned: 0 in 0.474s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:29 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Downloaded image 81ac455d-f592-4ef7-8c27-23e4054a633b ((None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}])) to volume dfad796b-826a-4ad8-af18-5f41f56689e6 successfully. {{(pid=85899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 17:46:29 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Temporary image 81ac455d-f592-4ef7-8c27-23e4054a633b for user 2200e0e18b4a46cdbfe6ee8c15ff8832 is deleted. {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 16 17:46:29 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Marking volume dfad796b-826a-4ad8-af18-5f41f56689e6 as bootable. {{(pid=85899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 17:46:29 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Copying metadata from image 81ac455d-f592-4ef7-8c27-23e4054a633b to dfad796b-826a-4ad8-af18-5f41f56689e6. {{(pid=85899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 17:46:29 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Creating volume glance metadata for volume dfad796b-826a-4ad8-af18-5f41f56689e6 backed by image 81ac455d-f592-4ef7-8c27-23e4054a633b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eac3b6c-2703-435f-8daf-9febb0054aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfad796b-826a-4ad8-af18-5f41f56689e6', 'volume_size': 1, 'image_id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '124a9fc6f0b448c1afab7b2b666efe75', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'created_at': datetime.datetime(2026, 9, 16, 15, 30, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 30, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81ac455d-f592-4ef7-8c27-23e4054a633b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ac111f-6206-4821-8a8e-69211998fa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:30 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Volume volume-dfad796b-826a-4ad8-af18-5f41f56689e6 (dfad796b-826a-4ad8-af18-5f41f56689e6): created successfully Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ac111f-6206-4821-8a8e-69211998fa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Flow 'volume_create_manager' (6865603d-2059-4b0c-a088-a5426c46632f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:46:30 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-2bc9d3a4-b7cb-4a07-abdd-0639b79498d7 tempest-VolumesImageMetadata-1978974080 None] Created volume successfully. Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Flow 'volume_create_manager' (e19d8236-6e70-4a2c-bd07-491bc9ec5412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27158dc9-336f-4816-a18a-a884318c0c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27158dc9-336f-4816-a18a-a884318c0c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-791217757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8faf4d833a5b4e9baaa017bd8d4af3b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:46:31Z,use_quota=True,user_id='7439398770884a3388e997e284b23644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda97bcc-1fc7-4283-aab2-93f961750998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda97bcc-1fc7-4283-aab2-93f961750998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de80a78-5c7d-4cd2-b5b5-9acb6d2fed88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de80a78-5c7d-4cd2-b5b5-9acb6d2fed88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc', 'volume_name': 'volume-72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120b670f-e873-42e7-8029-8023503885dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120b670f-e873-42e7-8029-8023503885dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f88372c-b7f5-4450-bca3-abdd7d9dbf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:30 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Volume 72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc', 'volume_size': 1} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-791217757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8faf4d833a5b4e9baaa017bd8d4af3b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:46:31Z,use_quota=True,user_id='7439398770884a3388e997e284b23644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Creating volume 72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:46:30 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:30 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc 1073741824 Sep 16 17:46:30 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5f801140-134f-4518-9e51-0d2a575be216 tempest-VolumesImageMetadata-1978974080 None] Acquiring lock "cinder-dfad796b-826a-4ad8-af18-5f41f56689e6-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:46:30 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5f801140-134f-4518-9e51-0d2a575be216 tempest-VolumesImageMetadata-1978974080 None] Lock "cinder-dfad796b-826a-4ad8-af18-5f41f56689e6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:46:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5f801140-134f-4518-9e51-0d2a575be216 tempest-VolumesImageMetadata-1978974080 None] Acquiring lock "cinder-quobyte-dfad796b-826a-4ad8-af18-5f41f56689e6" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:46:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5f801140-134f-4518-9e51-0d2a575be216 tempest-VolumesImageMetadata-1978974080 None] Lock "cinder-quobyte-dfad796b-826a-4ad8-af18-5f41f56689e6" acquired by "delete_volume" :: waited 0.030s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:46:31 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ac511b-d49e-4025-bee6-e4f42d4c8f81]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:46:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f801140-134f-4518-9e51-0d2a575be216 tempest-VolumesImageMetadata-1978974080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dfad796b-826a-4ad8-af18-5f41f56689e6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:31 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dfad796b-826a-4ad8-af18-5f41f56689e6 Sep 16 17:46:31 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:31 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc 1073741824" returned: 0 in 0.618s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:31 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc Sep 16 17:46:31 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:31 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f801140-134f-4518-9e51-0d2a575be216 tempest-VolumesImageMetadata-1978974080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dfad796b-826a-4ad8-af18-5f41f56689e6" returned: 0 in 0.509s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f801140-134f-4518-9e51-0d2a575be216 tempest-VolumesImageMetadata-1978974080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dfad796b-826a-4ad8-af18-5f41f56689e6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:31 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dfad796b-826a-4ad8-af18-5f41f56689e6 Sep 16 17:46:31 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:31 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc" returned: 0 in 0.355s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:31 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:46:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:31 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f88372c-b7f5-4450-bca3-abdd7d9dbf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:31 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b94551-2449-44aa-9bd4-447636b46f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:31 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Volume volume-72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc (72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc): created successfully Sep 16 17:46:31 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b94551-2449-44aa-9bd4-447636b46f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:31 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Flow 'volume_create_manager' (e19d8236-6e70-4a2c-bd07-491bc9ec5412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:46:31 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-80aa596e-34f3-4c15-ab49-298ddd820a8d tempest-AttachVolumeTestJSON-115136149 None] Created volume successfully. Sep 16 17:46:31 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f801140-134f-4518-9e51-0d2a575be216 tempest-VolumesImageMetadata-1978974080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dfad796b-826a-4ad8-af18-5f41f56689e6" returned: 0 in 0.324s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:32 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5f801140-134f-4518-9e51-0d2a575be216 tempest-VolumesImageMetadata-1978974080 None] Lock "cinder-quobyte-dfad796b-826a-4ad8-af18-5f41f56689e6" released by "delete_volume" :: held 0.935s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:46:32 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-5f801140-134f-4518-9e51-0d2a575be216 tempest-VolumesImageMetadata-1978974080 None] Created reservations ['c0d5d513-1856-4e74-8e21-2f3e9ab50b93', '8bcd187a-c9b6-443f-8f41-25f990067225', '307f8823-61fe-401d-91d3-2a23530d96e2', 'd86ec907-aa06-495f-a906-ce4b31aee2cb'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:46:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5f801140-134f-4518-9e51-0d2a575be216 tempest-VolumesImageMetadata-1978974080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5f801140-134f-4518-9e51-0d2a575be216 tempest-VolumesImageMetadata-1978974080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5f801140-134f-4518-9e51-0d2a575be216 tempest-VolumesImageMetadata-1978974080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:46:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5f801140-134f-4518-9e51-0d2a575be216 tempest-VolumesImageMetadata-1978974080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:46:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5f801140-134f-4518-9e51-0d2a575be216 tempest-VolumesImageMetadata-1978974080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f801140-134f-4518-9e51-0d2a575be216 tempest-VolumesImageMetadata-1978974080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:32 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:46:32 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:32 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5f801140-134f-4518-9e51-0d2a575be216 tempest-VolumesImageMetadata-1978974080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.261s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:32 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-5f801140-134f-4518-9e51-0d2a575be216 tempest-VolumesImageMetadata-1978974080 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:46:32 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5f801140-134f-4518-9e51-0d2a575be216 tempest-VolumesImageMetadata-1978974080 None] Deleted volume successfully. Sep 16 17:46:32 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5f801140-134f-4518-9e51-0d2a575be216 tempest-VolumesImageMetadata-1978974080 None] Lock "cinder-dfad796b-826a-4ad8-af18-5f41f56689e6-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:46:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-d46e94c8-c11c-46f6-862c-fe22077406c8 req-be9b0e0d-b5cf-4217-9b33-3e547adf05f6 tempest-AttachVolumeTestJSON-115136149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-d46e94c8-c11c-46f6-862c-fe22077406c8 req-be9b0e0d-b5cf-4217-9b33-3e547adf05f6 tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-d46e94c8-c11c-46f6-862c-fe22077406c8 req-be9b0e0d-b5cf-4217-9b33-3e547adf05f6 tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-d46e94c8-c11c-46f6-862c-fe22077406c8 req-be9b0e0d-b5cf-4217-9b33-3e547adf05f6 tempest-AttachVolumeTestJSON-115136149 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7', 'name': 'volume-72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e13b6f84-0456-443c-bde0-a9d66ab9b4d9', 'enforce_multipath': True} {{(pid=85899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4920}} Sep 16 17:46:33 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-d46e94c8-c11c-46f6-862c-fe22077406c8 req-be9b0e0d-b5cf-4217-9b33-3e547adf05f6 tempest-AttachVolumeTestJSON-115136149 None] attachment_update completed successfully. Sep 16 17:46:36 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-9777a72e-c913-4646-96b4-ce05c9288211 req-f9fc249c-a64a-44bc-958e-8ffac1822dc5 tempest-AttachVolumeTestJSON-115136149 None] Terminate volume connection completed successfully. Sep 16 17:46:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-9777a72e-c913-4646-96b4-ce05c9288211 req-f9fc249c-a64a-44bc-958e-8ffac1822dc5 tempest-AttachVolumeTestJSON-115136149 None] Deleting attachment 06360167-aa60-45f2-9673-af4c5da9a89e. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:46:38 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-72e7d476-3632-442f-b9ba-f7940706176a req-ca919fae-3fa5-4c05-8220-8a4b82f96d34 tempest-AttachVolumeTestJSON-115136149 None] Terminate volume connection completed successfully. Sep 16 17:46:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-72e7d476-3632-442f-b9ba-f7940706176a req-ca919fae-3fa5-4c05-8220-8a4b82f96d34 tempest-AttachVolumeTestJSON-115136149 None] Deleting attachment e13b6f84-0456-443c-bde0-a9d66ab9b4d9. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:46:38 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:46:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Flow 'volume_create_manager' (3409eec9-1537-4589-9ee0-b64ddb3bd4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:46:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180341be-b072-4717-be1d-94ccc202c39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180341be-b072-4717-be1d-94ccc202c39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-588350698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3df6e6e-bb81-412a-93f4-fcf5715a2b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='873437503ebb4e58b58d792cb26c0231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:46:39Z,use_quota=True,user_id='6e4d57d73e334cc1af4dd64501fc51b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47fbcaba-e56d-4608-b309-9d18c6721d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47fbcaba-e56d-4608-b309-9d18c6721d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad76f61-f132-4b11-acca-8b2c93a5328a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad76f61-f132-4b11-acca-8b2c93a5328a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3df6e6e-bb81-412a-93f4-fcf5715a2b34', 'volume_name': 'volume-d3df6e6e-bb81-412a-93f4-fcf5715a2b34', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db9014c-9a5b-4f56-b643-4a7287d46515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db9014c-9a5b-4f56-b643-4a7287d46515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ba9522-5154-45cc-88d1-46fdd73e5140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:38 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Volume d3df6e6e-bb81-412a-93f4-fcf5715a2b34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3df6e6e-bb81-412a-93f4-fcf5715a2b34', 'volume_size': 1} Sep 16 17:46:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-588350698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3df6e6e-bb81-412a-93f4-fcf5715a2b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='873437503ebb4e58b58d792cb26c0231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:46:39Z,use_quota=True,user_id='6e4d57d73e334cc1af4dd64501fc51b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:46:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Creating volume d3df6e6e-bb81-412a-93f4-fcf5715a2b34 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:46:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:46:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:46:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:46:38 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:46:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d3df6e6e-bb81-412a-93f4-fcf5715a2b34 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:38 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d3df6e6e-bb81-412a-93f4-fcf5715a2b34 1073741824 Sep 16 17:46:38 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:39 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d3df6e6e-bb81-412a-93f4-fcf5715a2b34 1073741824" returned: 0 in 0.749s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d3df6e6e-bb81-412a-93f4-fcf5715a2b34 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:39 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d3df6e6e-bb81-412a-93f4-fcf5715a2b34 Sep 16 17:46:39 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:39 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d3df6e6e-bb81-412a-93f4-fcf5715a2b34" returned: 0 in 0.366s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:46:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ba9522-5154-45cc-88d1-46fdd73e5140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3df6e6e-bb81-412a-93f4-fcf5715a2b34', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8f30cb-c699-402e-b630-f8b7ce76076c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:40 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Volume volume-d3df6e6e-bb81-412a-93f4-fcf5715a2b34 (d3df6e6e-bb81-412a-93f4-fcf5715a2b34): created successfully Sep 16 17:46:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8f30cb-c699-402e-b630-f8b7ce76076c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Flow 'volume_create_manager' (3409eec9-1537-4589-9ee0-b64ddb3bd4a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:46:40 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-2cc6be38-3968-4f5e-9096-3af09cba0b02 tempest-VolumesMetadataTest-1024045178 None] Created volume successfully. Sep 16 17:46:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-711d045b-5a93-4c99-83e1-ed11bdcfa373 tempest-VolumesMetadataTest-1024045178 None] Acquiring lock "cinder-d3df6e6e-bb81-412a-93f4-fcf5715a2b34-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:46:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-711d045b-5a93-4c99-83e1-ed11bdcfa373 tempest-VolumesMetadataTest-1024045178 None] Lock "cinder-d3df6e6e-bb81-412a-93f4-fcf5715a2b34-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:46:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-711d045b-5a93-4c99-83e1-ed11bdcfa373 tempest-VolumesMetadataTest-1024045178 None] Acquiring lock "cinder-quobyte-d3df6e6e-bb81-412a-93f4-fcf5715a2b34" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:46:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-711d045b-5a93-4c99-83e1-ed11bdcfa373 tempest-VolumesMetadataTest-1024045178 None] Lock "cinder-quobyte-d3df6e6e-bb81-412a-93f4-fcf5715a2b34" acquired by "delete_volume" :: waited 0.031s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:46:42 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9ff114-ccf7-44e1-afae-4e63c1edda34]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:46:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-711d045b-5a93-4c99-83e1-ed11bdcfa373 tempest-VolumesMetadataTest-1024045178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d3df6e6e-bb81-412a-93f4-fcf5715a2b34 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:42 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d3df6e6e-bb81-412a-93f4-fcf5715a2b34 Sep 16 17:46:42 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:42 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-711d045b-5a93-4c99-83e1-ed11bdcfa373 tempest-VolumesMetadataTest-1024045178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d3df6e6e-bb81-412a-93f4-fcf5715a2b34" returned: 0 in 0.413s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-711d045b-5a93-4c99-83e1-ed11bdcfa373 tempest-VolumesMetadataTest-1024045178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d3df6e6e-bb81-412a-93f4-fcf5715a2b34 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:42 devstack sudo[97428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d3df6e6e-bb81-412a-93f4-fcf5715a2b34 Sep 16 17:46:42 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:42 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-711d045b-5a93-4c99-83e1-ed11bdcfa373 tempest-VolumesMetadataTest-1024045178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d3df6e6e-bb81-412a-93f4-fcf5715a2b34" returned: 0 in 0.251s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-711d045b-5a93-4c99-83e1-ed11bdcfa373 tempest-VolumesMetadataTest-1024045178 None] Lock "cinder-quobyte-d3df6e6e-bb81-412a-93f4-fcf5715a2b34" released by "delete_volume" :: held 0.729s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:46:42 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-711d045b-5a93-4c99-83e1-ed11bdcfa373 tempest-VolumesMetadataTest-1024045178 None] Created reservations ['db23a41a-1bc9-4122-a286-20812c64452c', '43f69869-ae08-48e9-aa03-f2eea74622c9', '4d946b89-22d3-4987-9ce6-00f6a6fa5e7c', '3407b21b-32cf-43d9-a08c-b0debb34a1bc'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:46:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-711d045b-5a93-4c99-83e1-ed11bdcfa373 tempest-VolumesMetadataTest-1024045178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-711d045b-5a93-4c99-83e1-ed11bdcfa373 tempest-VolumesMetadataTest-1024045178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-711d045b-5a93-4c99-83e1-ed11bdcfa373 tempest-VolumesMetadataTest-1024045178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:46:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-711d045b-5a93-4c99-83e1-ed11bdcfa373 tempest-VolumesMetadataTest-1024045178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:46:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-711d045b-5a93-4c99-83e1-ed11bdcfa373 tempest-VolumesMetadataTest-1024045178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-711d045b-5a93-4c99-83e1-ed11bdcfa373 tempest-VolumesMetadataTest-1024045178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:42 devstack sudo[97431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:46:42 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:43 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-711d045b-5a93-4c99-83e1-ed11bdcfa373 tempest-VolumesMetadataTest-1024045178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.294s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:43 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-711d045b-5a93-4c99-83e1-ed11bdcfa373 tempest-VolumesMetadataTest-1024045178 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:46:43 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-711d045b-5a93-4c99-83e1-ed11bdcfa373 tempest-VolumesMetadataTest-1024045178 None] Deleted volume successfully. Sep 16 17:46:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-711d045b-5a93-4c99-83e1-ed11bdcfa373 tempest-VolumesMetadataTest-1024045178 None] Lock "cinder-d3df6e6e-bb81-412a-93f4-fcf5715a2b34-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:46:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-795f87b2-4cf5-47a6-b8b2-9cd77ad6181e tempest-AttachVolumeTestJSON-115136149 None] Acquiring lock "cinder-72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:46:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-795f87b2-4cf5-47a6-b8b2-9cd77ad6181e tempest-AttachVolumeTestJSON-115136149 None] Lock "cinder-72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:46:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-795f87b2-4cf5-47a6-b8b2-9cd77ad6181e tempest-AttachVolumeTestJSON-115136149 None] Acquiring lock "cinder-quobyte-72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:46:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-795f87b2-4cf5-47a6-b8b2-9cd77ad6181e tempest-AttachVolumeTestJSON-115136149 None] Lock "cinder-quobyte-72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc" acquired by "delete_volume" :: waited 0.014s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:46:43 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[38dd6de1-b57c-4904-91c5-55e9b4df9617]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:46:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-795f87b2-4cf5-47a6-b8b2-9cd77ad6181e tempest-AttachVolumeTestJSON-115136149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:43 devstack sudo[97437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc Sep 16 17:46:43 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:44 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-795f87b2-4cf5-47a6-b8b2-9cd77ad6181e tempest-AttachVolumeTestJSON-115136149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc" returned: 0 in 0.395s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-795f87b2-4cf5-47a6-b8b2-9cd77ad6181e tempest-AttachVolumeTestJSON-115136149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:44 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc Sep 16 17:46:44 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:44 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-795f87b2-4cf5-47a6-b8b2-9cd77ad6181e tempest-AttachVolumeTestJSON-115136149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc" returned: 0 in 0.248s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-795f87b2-4cf5-47a6-b8b2-9cd77ad6181e tempest-AttachVolumeTestJSON-115136149 None] Lock "cinder-quobyte-72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc" released by "delete_volume" :: held 0.691s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:46:44 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-795f87b2-4cf5-47a6-b8b2-9cd77ad6181e tempest-AttachVolumeTestJSON-115136149 None] Created reservations ['e2729c4d-c260-4987-9756-fdc6a57a2b24', '9e870263-d473-4e1f-bfa3-f53adc4d488d', '182ffd97-992f-45a9-88dc-a5b779d77dbe', '7dd6f8e9-96ac-4fc9-b85a-b072b4c4be92'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:46:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-795f87b2-4cf5-47a6-b8b2-9cd77ad6181e tempest-AttachVolumeTestJSON-115136149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-795f87b2-4cf5-47a6-b8b2-9cd77ad6181e tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-795f87b2-4cf5-47a6-b8b2-9cd77ad6181e tempest-AttachVolumeTestJSON-115136149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:46:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-795f87b2-4cf5-47a6-b8b2-9cd77ad6181e tempest-AttachVolumeTestJSON-115136149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:46:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-795f87b2-4cf5-47a6-b8b2-9cd77ad6181e tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-795f87b2-4cf5-47a6-b8b2-9cd77ad6181e tempest-AttachVolumeTestJSON-115136149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:44 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:46:44 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:44 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-19a28795-3b13-4494-861d-c6a6509f68dc tempest-AttachVolumeTestJSON-115136149 None] Acquiring lock "cinder-4fa19975-d25b-4188-8285-f0b8a01895a2-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:46:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-795f87b2-4cf5-47a6-b8b2-9cd77ad6181e tempest-AttachVolumeTestJSON-115136149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.270s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:44 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-795f87b2-4cf5-47a6-b8b2-9cd77ad6181e tempest-AttachVolumeTestJSON-115136149 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:46:44 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-795f87b2-4cf5-47a6-b8b2-9cd77ad6181e tempest-AttachVolumeTestJSON-115136149 None] Deleted volume successfully. Sep 16 17:46:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-19a28795-3b13-4494-861d-c6a6509f68dc tempest-AttachVolumeTestJSON-115136149 None] Lock "cinder-4fa19975-d25b-4188-8285-f0b8a01895a2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:46:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-795f87b2-4cf5-47a6-b8b2-9cd77ad6181e tempest-AttachVolumeTestJSON-115136149 None] Lock "cinder-72fe814e-df0e-4e8b-9d1c-cdbb92bba7cc-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:46:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-19a28795-3b13-4494-861d-c6a6509f68dc tempest-AttachVolumeTestJSON-115136149 None] Acquiring lock "cinder-quobyte-4fa19975-d25b-4188-8285-f0b8a01895a2" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:46:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-19a28795-3b13-4494-861d-c6a6509f68dc tempest-AttachVolumeTestJSON-115136149 None] Lock "cinder-quobyte-4fa19975-d25b-4188-8285-f0b8a01895a2" acquired by "delete_volume" :: waited 0.015s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:46:44 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5932e8-3cbc-458c-a1e0-b6da18674026]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:46:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-19a28795-3b13-4494-861d-c6a6509f68dc tempest-AttachVolumeTestJSON-115136149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4fa19975-d25b-4188-8285-f0b8a01895a2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:45 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4fa19975-d25b-4188-8285-f0b8a01895a2 Sep 16 17:46:45 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:45 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-19a28795-3b13-4494-861d-c6a6509f68dc tempest-AttachVolumeTestJSON-115136149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4fa19975-d25b-4188-8285-f0b8a01895a2" returned: 0 in 0.374s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-19a28795-3b13-4494-861d-c6a6509f68dc tempest-AttachVolumeTestJSON-115136149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4fa19975-d25b-4188-8285-f0b8a01895a2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:45 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4fa19975-d25b-4188-8285-f0b8a01895a2 Sep 16 17:46:45 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:45 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-19a28795-3b13-4494-861d-c6a6509f68dc tempest-AttachVolumeTestJSON-115136149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4fa19975-d25b-4188-8285-f0b8a01895a2" returned: 0 in 0.262s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-19a28795-3b13-4494-861d-c6a6509f68dc tempest-AttachVolumeTestJSON-115136149 None] Lock "cinder-quobyte-4fa19975-d25b-4188-8285-f0b8a01895a2" released by "delete_volume" :: held 0.689s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:46:45 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-19a28795-3b13-4494-861d-c6a6509f68dc tempest-AttachVolumeTestJSON-115136149 None] Created reservations ['106027fa-56de-49ba-97ce-212e2f50b28a', 'cd1368b1-87c9-417c-81fc-f400a16ff9e6', '29870966-4531-49e7-a52b-56f257dfca4d', '949d2a83-54db-4462-8576-1fb0790daefa'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:46:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-19a28795-3b13-4494-861d-c6a6509f68dc tempest-AttachVolumeTestJSON-115136149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-19a28795-3b13-4494-861d-c6a6509f68dc tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-19a28795-3b13-4494-861d-c6a6509f68dc tempest-AttachVolumeTestJSON-115136149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:46:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-19a28795-3b13-4494-861d-c6a6509f68dc tempest-AttachVolumeTestJSON-115136149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:46:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-19a28795-3b13-4494-861d-c6a6509f68dc tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-19a28795-3b13-4494-861d-c6a6509f68dc tempest-AttachVolumeTestJSON-115136149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:45 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:46:45 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:46 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-19a28795-3b13-4494-861d-c6a6509f68dc tempest-AttachVolumeTestJSON-115136149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.288s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:46 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-19a28795-3b13-4494-861d-c6a6509f68dc tempest-AttachVolumeTestJSON-115136149 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:46:46 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-19a28795-3b13-4494-861d-c6a6509f68dc tempest-AttachVolumeTestJSON-115136149 None] Deleted volume successfully. Sep 16 17:46:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-19a28795-3b13-4494-861d-c6a6509f68dc tempest-AttachVolumeTestJSON-115136149 None] Lock "cinder-4fa19975-d25b-4188-8285-f0b8a01895a2-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:46:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9e6a4328-5805-4601-978c-c28866a416b3 tempest-AttachVolumeTestJSON-115136149 None] Acquiring lock "cinder-fca223d0-678d-4d03-ad84-99ef50cc20b9-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:46:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9e6a4328-5805-4601-978c-c28866a416b3 tempest-AttachVolumeTestJSON-115136149 None] Lock "cinder-fca223d0-678d-4d03-ad84-99ef50cc20b9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:46:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9e6a4328-5805-4601-978c-c28866a416b3 tempest-AttachVolumeTestJSON-115136149 None] Acquiring lock "cinder-quobyte-fca223d0-678d-4d03-ad84-99ef50cc20b9" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:46:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9e6a4328-5805-4601-978c-c28866a416b3 tempest-AttachVolumeTestJSON-115136149 None] Lock "cinder-quobyte-fca223d0-678d-4d03-ad84-99ef50cc20b9" acquired by "delete_volume" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:46:46 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce39a2b-1e80-411b-813d-bee7319b7334]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:46:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9e6a4328-5805-4601-978c-c28866a416b3 tempest-AttachVolumeTestJSON-115136149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fca223d0-678d-4d03-ad84-99ef50cc20b9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:46 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fca223d0-678d-4d03-ad84-99ef50cc20b9 Sep 16 17:46:46 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:46 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9e6a4328-5805-4601-978c-c28866a416b3 tempest-AttachVolumeTestJSON-115136149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fca223d0-678d-4d03-ad84-99ef50cc20b9" returned: 0 in 0.388s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9e6a4328-5805-4601-978c-c28866a416b3 tempest-AttachVolumeTestJSON-115136149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fca223d0-678d-4d03-ad84-99ef50cc20b9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:46 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fca223d0-678d-4d03-ad84-99ef50cc20b9 Sep 16 17:46:46 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:46 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9e6a4328-5805-4601-978c-c28866a416b3 tempest-AttachVolumeTestJSON-115136149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fca223d0-678d-4d03-ad84-99ef50cc20b9" returned: 0 in 0.273s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9e6a4328-5805-4601-978c-c28866a416b3 tempest-AttachVolumeTestJSON-115136149 None] Lock "cinder-quobyte-fca223d0-678d-4d03-ad84-99ef50cc20b9" released by "delete_volume" :: held 0.712s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:46:47 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-9e6a4328-5805-4601-978c-c28866a416b3 tempest-AttachVolumeTestJSON-115136149 None] Created reservations ['b0d98cd2-3516-43f7-af7e-c5bb58c86d47', 'c9e80e34-320e-4266-a25b-f4164276c889', 'edeb0d0e-35ce-4452-a0d0-10b5113553f1', '54418dce-0326-4aa1-a483-d5a8533d3f99'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:46:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9e6a4328-5805-4601-978c-c28866a416b3 tempest-AttachVolumeTestJSON-115136149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9e6a4328-5805-4601-978c-c28866a416b3 tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9e6a4328-5805-4601-978c-c28866a416b3 tempest-AttachVolumeTestJSON-115136149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:46:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9e6a4328-5805-4601-978c-c28866a416b3 tempest-AttachVolumeTestJSON-115136149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:46:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9e6a4328-5805-4601-978c-c28866a416b3 tempest-AttachVolumeTestJSON-115136149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9e6a4328-5805-4601-978c-c28866a416b3 tempest-AttachVolumeTestJSON-115136149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:47 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:46:47 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:47 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9e6a4328-5805-4601-978c-c28866a416b3 tempest-AttachVolumeTestJSON-115136149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.268s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:47 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-9e6a4328-5805-4601-978c-c28866a416b3 tempest-AttachVolumeTestJSON-115136149 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:46:47 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-9e6a4328-5805-4601-978c-c28866a416b3 tempest-AttachVolumeTestJSON-115136149 None] Deleted volume successfully. Sep 16 17:46:47 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9e6a4328-5805-4601-978c-c28866a416b3 tempest-AttachVolumeTestJSON-115136149 None] Lock "cinder-fca223d0-678d-4d03-ad84-99ef50cc20b9-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:46:48 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:46:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Flow 'volume_create_manager' (7562bf10-4ca0-4e5b-a5ca-434526d23901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:46:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbea8f9a-4bfd-41e4-8309-1840cb7b5e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbea8f9a-4bfd-41e4-8309-1840cb7b5e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-104745991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41671083-a911-4cf7-b4cf-463e9c5f6236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='568da652ce534b32a4986009eeba2e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:46:48Z,use_quota=True,user_id='33078fd1d3d9430d8dc26d4d48f7ec50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca91444f-00bf-4329-b276-9c2e08ddc6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca91444f-00bf-4329-b276-9c2e08ddc6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b02ba1ba-f9d2-47f1-91db-fedb9d1fc992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b02ba1ba-f9d2-47f1-91db-fedb9d1fc992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41671083-a911-4cf7-b4cf-463e9c5f6236', 'volume_name': 'volume-41671083-a911-4cf7-b4cf-463e9c5f6236', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4ab9ab-9ecd-404f-ac1c-20e35115cefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4ab9ab-9ecd-404f-ac1c-20e35115cefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63aed56b-ef62-44fd-8931-ae31d077edb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:48 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Volume 41671083-a911-4cf7-b4cf-463e9c5f6236: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41671083-a911-4cf7-b4cf-463e9c5f6236', 'volume_size': 1} Sep 16 17:46:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-104745991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41671083-a911-4cf7-b4cf-463e9c5f6236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='568da652ce534b32a4986009eeba2e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:46:48Z,use_quota=True,user_id='33078fd1d3d9430d8dc26d4d48f7ec50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:46:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Creating volume 41671083-a911-4cf7-b4cf-463e9c5f6236 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:46:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:46:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:46:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:46:48 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:46:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41671083-a911-4cf7-b4cf-463e9c5f6236 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:48 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41671083-a911-4cf7-b4cf-463e9c5f6236 1073741824 Sep 16 17:46:48 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:49 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41671083-a911-4cf7-b4cf-463e9c5f6236 1073741824" returned: 0 in 0.485s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41671083-a911-4cf7-b4cf-463e9c5f6236 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:49 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41671083-a911-4cf7-b4cf-463e9c5f6236 Sep 16 17:46:49 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:49 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41671083-a911-4cf7-b4cf-463e9c5f6236" returned: 0 in 0.310s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:46:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63aed56b-ef62-44fd-8931-ae31d077edb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41671083-a911-4cf7-b4cf-463e9c5f6236', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba64328f-2e9f-435d-b9b4-212b0944d74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:49 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Volume volume-41671083-a911-4cf7-b4cf-463e9c5f6236 (41671083-a911-4cf7-b4cf-463e9c5f6236): created successfully Sep 16 17:46:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba64328f-2e9f-435d-b9b4-212b0944d74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Flow 'volume_create_manager' (7562bf10-4ca0-4e5b-a5ca-434526d23901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:46:49 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-463d10e0-7756-46f5-ac60-4cbf03c36511 tempest-VolumesTransfersV355Test-1660369294 None] Created volume successfully. Sep 16 17:46:51 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-4b7dfcb8-0189-4dcb-967a-873e31eaaf92 tempest-VolumesTransfersV355Test-1807524926 None] Transfer volume completed successfully. Sep 16 17:46:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-621c895a-8c7a-434e-9107-830d4d16b7b6 tempest-VolumesTransfersV355Test-1964140007 None] Acquiring lock "cinder-41671083-a911-4cf7-b4cf-463e9c5f6236-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:46:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-621c895a-8c7a-434e-9107-830d4d16b7b6 tempest-VolumesTransfersV355Test-1964140007 None] Lock "cinder-41671083-a911-4cf7-b4cf-463e9c5f6236-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:46:51 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:UPDATE=89,cinder:SELECT=96,cinder:INSERT=32,cinder:DELETE=9 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:46:51 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=102,cinder:UPDATE=101,cinder:INSERT=35,cinder:DELETE=7 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:46:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-621c895a-8c7a-434e-9107-830d4d16b7b6 tempest-VolumesTransfersV355Test-1964140007 None] Acquiring lock "cinder-quobyte-41671083-a911-4cf7-b4cf-463e9c5f6236" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:46:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-621c895a-8c7a-434e-9107-830d4d16b7b6 tempest-VolumesTransfersV355Test-1964140007 None] Lock "cinder-quobyte-41671083-a911-4cf7-b4cf-463e9c5f6236" acquired by "delete_volume" :: waited 0.022s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:46:51 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac8cf99-9513-4856-901e-71428a21777c]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:46:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-621c895a-8c7a-434e-9107-830d4d16b7b6 tempest-VolumesTransfersV355Test-1964140007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41671083-a911-4cf7-b4cf-463e9c5f6236 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:52 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41671083-a911-4cf7-b4cf-463e9c5f6236 Sep 16 17:46:52 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:52 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-621c895a-8c7a-434e-9107-830d4d16b7b6 tempest-VolumesTransfersV355Test-1964140007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41671083-a911-4cf7-b4cf-463e9c5f6236" returned: 0 in 0.478s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-621c895a-8c7a-434e-9107-830d4d16b7b6 tempest-VolumesTransfersV355Test-1964140007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41671083-a911-4cf7-b4cf-463e9c5f6236 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:52 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41671083-a911-4cf7-b4cf-463e9c5f6236 Sep 16 17:46:52 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:52 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-621c895a-8c7a-434e-9107-830d4d16b7b6 tempest-VolumesTransfersV355Test-1964140007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41671083-a911-4cf7-b4cf-463e9c5f6236" returned: 0 in 0.292s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:52 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-621c895a-8c7a-434e-9107-830d4d16b7b6 tempest-VolumesTransfersV355Test-1964140007 None] Lock "cinder-quobyte-41671083-a911-4cf7-b4cf-463e9c5f6236" released by "delete_volume" :: held 0.838s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:46:52 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-621c895a-8c7a-434e-9107-830d4d16b7b6 tempest-VolumesTransfersV355Test-1964140007 None] Created reservations ['aea734b8-db6e-469e-864f-443b370268bd', '31dadb98-2cf9-4762-9baf-5b8ef4172be5', '3a59f713-7c84-4bba-ab2c-caf36150d1a6', 'd3825802-cb14-45dc-b8b0-b330de581a7a'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:46:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-621c895a-8c7a-434e-9107-830d4d16b7b6 tempest-VolumesTransfersV355Test-1964140007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-621c895a-8c7a-434e-9107-830d4d16b7b6 tempest-VolumesTransfersV355Test-1964140007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-621c895a-8c7a-434e-9107-830d4d16b7b6 tempest-VolumesTransfersV355Test-1964140007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:46:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-621c895a-8c7a-434e-9107-830d4d16b7b6 tempest-VolumesTransfersV355Test-1964140007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:46:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-621c895a-8c7a-434e-9107-830d4d16b7b6 tempest-VolumesTransfersV355Test-1964140007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-621c895a-8c7a-434e-9107-830d4d16b7b6 tempest-VolumesTransfersV355Test-1964140007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:52 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:46:52 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:53 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-621c895a-8c7a-434e-9107-830d4d16b7b6 tempest-VolumesTransfersV355Test-1964140007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.452s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-621c895a-8c7a-434e-9107-830d4d16b7b6 tempest-VolumesTransfersV355Test-1964140007 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:46:53 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-621c895a-8c7a-434e-9107-830d4d16b7b6 tempest-VolumesTransfersV355Test-1964140007 None] Deleted volume successfully. Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-621c895a-8c7a-434e-9107-830d4d16b7b6 tempest-VolumesTransfersV355Test-1964140007 None] Lock "cinder-41671083-a911-4cf7-b4cf-463e9c5f6236-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Flow 'volume_create_manager' (12cab759-ea9a-4938-b300-a91d50e9a710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56dd7570-ef68-4513-adfb-67cab77820b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56dd7570-ef68-4513-adfb-67cab77820b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1493309801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20916802-80fc-4489-a89a-e4210ee41547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='568da652ce534b32a4986009eeba2e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:46:54Z,use_quota=True,user_id='33078fd1d3d9430d8dc26d4d48f7ec50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ee9161-55a2-4f1d-b752-30065c8897c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ee9161-55a2-4f1d-b752-30065c8897c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b42b8ea-8c15-4941-9d52-7776f81af864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b42b8ea-8c15-4941-9d52-7776f81af864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20916802-80fc-4489-a89a-e4210ee41547', 'volume_name': 'volume-20916802-80fc-4489-a89a-e4210ee41547', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb1ae5a-f29d-4fc2-990b-82b586fef432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb1ae5a-f29d-4fc2-990b-82b586fef432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6a32ed-5171-4030-a994-ecbfcc2cf944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:53 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Volume 20916802-80fc-4489-a89a-e4210ee41547: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20916802-80fc-4489-a89a-e4210ee41547', 'volume_size': 1} Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1493309801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20916802-80fc-4489-a89a-e4210ee41547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='568da652ce534b32a4986009eeba2e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:46:54Z,use_quota=True,user_id='33078fd1d3d9430d8dc26d4d48f7ec50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Creating volume 20916802-80fc-4489-a89a-e4210ee41547 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:46:53 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:46:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20916802-80fc-4489-a89a-e4210ee41547 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:53 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20916802-80fc-4489-a89a-e4210ee41547 1073741824 Sep 16 17:46:53 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:54 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-a8e607e9-83de-43a5-a579-5ce981711459 req-7aa16e8c-f361-484c-85bd-79d5a9be52d0 tempest-TestShelveInstance-484011381 None] Terminate volume connection completed successfully. Sep 16 17:46:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-a8e607e9-83de-43a5-a579-5ce981711459 req-7aa16e8c-f361-484c-85bd-79d5a9be52d0 tempest-TestShelveInstance-484011381 None] Deleting attachment 0a3b7bff-d29a-4b5d-b8f1-4de2ecd57949. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:46:54 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20916802-80fc-4489-a89a-e4210ee41547 1073741824" returned: 0 in 0.573s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20916802-80fc-4489-a89a-e4210ee41547 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:54 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20916802-80fc-4489-a89a-e4210ee41547 Sep 16 17:46:54 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:54 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20916802-80fc-4489-a89a-e4210ee41547" returned: 0 in 0.302s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:54 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:46:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6a32ed-5171-4030-a994-ecbfcc2cf944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20916802-80fc-4489-a89a-e4210ee41547', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74a3d73-3d8e-479a-a628-347ab1e9cdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:46:54 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Volume volume-20916802-80fc-4489-a89a-e4210ee41547 (20916802-80fc-4489-a89a-e4210ee41547): created successfully Sep 16 17:46:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74a3d73-3d8e-479a-a628-347ab1e9cdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:46:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Flow 'volume_create_manager' (12cab759-ea9a-4938-b300-a91d50e9a710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:46:54 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-65e3b595-3f33-4bda-a296-ce57c9c41abf tempest-VolumesTransfersV355Test-1660369294 None] Created volume successfully. Sep 16 17:46:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9edd4bad-27c0-46a6-b0db-4d61512756ac tempest-VolumesTransfersV355Test-1964140007 None] Acquiring lock "cinder-20916802-80fc-4489-a89a-e4210ee41547-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:46:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9edd4bad-27c0-46a6-b0db-4d61512756ac tempest-VolumesTransfersV355Test-1964140007 None] Lock "cinder-20916802-80fc-4489-a89a-e4210ee41547-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:46:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9edd4bad-27c0-46a6-b0db-4d61512756ac tempest-VolumesTransfersV355Test-1964140007 None] Acquiring lock "cinder-quobyte-20916802-80fc-4489-a89a-e4210ee41547" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:46:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9edd4bad-27c0-46a6-b0db-4d61512756ac tempest-VolumesTransfersV355Test-1964140007 None] Lock "cinder-quobyte-20916802-80fc-4489-a89a-e4210ee41547" acquired by "delete_volume" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:46:56 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1170dad-ffb2-4f9f-bbd8-fe55c47f907a]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:46:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9edd4bad-27c0-46a6-b0db-4d61512756ac tempest-VolumesTransfersV355Test-1964140007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20916802-80fc-4489-a89a-e4210ee41547 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:56 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20916802-80fc-4489-a89a-e4210ee41547 Sep 16 17:46:56 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:56 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9edd4bad-27c0-46a6-b0db-4d61512756ac tempest-VolumesTransfersV355Test-1964140007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20916802-80fc-4489-a89a-e4210ee41547" returned: 0 in 0.397s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9edd4bad-27c0-46a6-b0db-4d61512756ac tempest-VolumesTransfersV355Test-1964140007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20916802-80fc-4489-a89a-e4210ee41547 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:56 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20916802-80fc-4489-a89a-e4210ee41547 Sep 16 17:46:56 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:56 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9edd4bad-27c0-46a6-b0db-4d61512756ac tempest-VolumesTransfersV355Test-1964140007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20916802-80fc-4489-a89a-e4210ee41547" returned: 0 in 0.291s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9edd4bad-27c0-46a6-b0db-4d61512756ac tempest-VolumesTransfersV355Test-1964140007 None] Lock "cinder-quobyte-20916802-80fc-4489-a89a-e4210ee41547" released by "delete_volume" :: held 0.753s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:46:57 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-9edd4bad-27c0-46a6-b0db-4d61512756ac tempest-VolumesTransfersV355Test-1964140007 None] Created reservations ['55f01ef9-e99d-4eb9-832f-e07a41022e74', 'd47b92ca-df02-4a53-8859-8e869338eb8e', 'a4ce4bfc-c84c-4939-9196-42fbb5167f09', '3e314dbd-3d86-4562-b5f8-8b60f9d8fb85'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:46:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9edd4bad-27c0-46a6-b0db-4d61512756ac tempest-VolumesTransfersV355Test-1964140007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9edd4bad-27c0-46a6-b0db-4d61512756ac tempest-VolumesTransfersV355Test-1964140007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9edd4bad-27c0-46a6-b0db-4d61512756ac tempest-VolumesTransfersV355Test-1964140007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:46:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9edd4bad-27c0-46a6-b0db-4d61512756ac tempest-VolumesTransfersV355Test-1964140007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:46:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9edd4bad-27c0-46a6-b0db-4d61512756ac tempest-VolumesTransfersV355Test-1964140007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9edd4bad-27c0-46a6-b0db-4d61512756ac tempest-VolumesTransfersV355Test-1964140007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:46:57 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:46:57 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:46:57 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Sep 16 17:46:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9edd4bad-27c0-46a6-b0db-4d61512756ac tempest-VolumesTransfersV355Test-1964140007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.363s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:46:57 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-9edd4bad-27c0-46a6-b0db-4d61512756ac tempest-VolumesTransfersV355Test-1964140007 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:46:57 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-9edd4bad-27c0-46a6-b0db-4d61512756ac tempest-VolumesTransfersV355Test-1964140007 None] Deleted volume successfully. Sep 16 17:46:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9edd4bad-27c0-46a6-b0db-4d61512756ac tempest-VolumesTransfersV355Test-1964140007 None] Lock "cinder-20916802-80fc-4489-a89a-e4210ee41547-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:46:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-1b7c05c4-0155-4778-b960-a2fc3470fef4 req-a2c98214-e7bf-4c02-9a0f-0eeb83c9469c tempest-TestShelveInstance-484011381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:46:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-1b7c05c4-0155-4778-b960-a2fc3470fef4 req-a2c98214-e7bf-4c02-9a0f-0eeb83c9469c tempest-TestShelveInstance-484011381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:46:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-1b7c05c4-0155-4778-b960-a2fc3470fef4 req-a2c98214-e7bf-4c02-9a0f-0eeb83c9469c tempest-TestShelveInstance-484011381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:46:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-1b7c05c4-0155-4778-b960-a2fc3470fef4 req-a2c98214-e7bf-4c02-9a0f-0eeb83c9469c tempest-TestShelveInstance-484011381 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7', 'name': 'volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e2a093c-c70b-4c2a-be86-299a5948a638', 'enforce_multipath': True} {{(pid=85899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4920}} Sep 16 17:46:57 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-1b7c05c4-0155-4778-b960-a2fc3470fef4 req-a2c98214-e7bf-4c02-9a0f-0eeb83c9469c tempest-TestShelveInstance-484011381 None] attachment_update completed successfully. Sep 16 17:47:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:47:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:47:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:47:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:02 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:47:02 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:02 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.343s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:47:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager._thread_info {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:47:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread count: 28 {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:47:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread info: [<_MainThread(MainThread, started 123748124422272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:47:06 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:47:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Flow 'volume_create_manager' (440dbfcf-ae3b-4485-861a-bd99452415a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:47:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f575b9ac-3f60-49f1-b595-0587016848fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f575b9ac-3f60-49f1-b595-0587016848fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1901822808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81953bc9-4c99-4a97-a6d1-81d98a5ae6ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='996517b7cfaa4fe6b45cb2ad564457d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:47:07Z,use_quota=True,user_id='f3caedfef2ea404790278fdda4660292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3403b5e0-e338-4caf-b016-7d51a2f6adab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3403b5e0-e338-4caf-b016-7d51a2f6adab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe5a98b9-11ae-4bcb-81d1-0f4e8a283a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe5a98b9-11ae-4bcb-81d1-0f4e8a283a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81953bc9-4c99-4a97-a6d1-81d98a5ae6ad', 'volume_name': 'volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ef328d-1419-4384-881a-d03b42119c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ef328d-1419-4384-881a-d03b42119c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aed112f-9759-48f6-80a7-9a11484ca512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:06 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Volume 81953bc9-4c99-4a97-a6d1-81d98a5ae6ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad', 'volume_size': 1} Sep 16 17:47:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:06 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1901822808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81953bc9-4c99-4a97-a6d1-81d98a5ae6ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='996517b7cfaa4fe6b45cb2ad564457d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:47:07Z,use_quota=True,user_id='f3caedfef2ea404790278fdda4660292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:47:06 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Creating volume 81953bc9-4c99-4a97-a6d1-81d98a5ae6ad {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:47:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:06 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:47:06 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:47:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:06 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:47:06 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:47:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:06 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad 1073741824 Sep 16 17:47:06 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:07 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad 1073741824" returned: 0 in 0.562s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:07 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad Sep 16 17:47:07 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:07 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad" returned: 0 in 0.317s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:07 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:47:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aed112f-9759-48f6-80a7-9a11484ca512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b219ad0-bef4-4181-80cb-1e074b9411a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:07 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Volume volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad (81953bc9-4c99-4a97-a6d1-81d98a5ae6ad): created successfully Sep 16 17:47:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b219ad0-bef4-4181-80cb-1e074b9411a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:07 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Flow 'volume_create_manager' (440dbfcf-ae3b-4485-861a-bd99452415a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:47:07 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-f5cb160c-e95c-4503-8a19-d8b0ee66542e tempest-VolumesCloneTest-410548931 None] Created volume successfully. Sep 16 17:47:09 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:47:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Flow 'volume_create_manager' (014a49aa-bbc3-43a2-b923-248da49e3e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:47:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962869ab-b70b-4d17-a1f8-347c59e3dbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962869ab-b70b-4d17-a1f8-347c59e3dbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-538249917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0381d0d1-89a8-4af1-8fdf-82c02ef915e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='996517b7cfaa4fe6b45cb2ad564457d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:47:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=81953bc9-4c99-4a97-a6d1-81d98a5ae6ad,status='creating',terminated_at=None,updated_at=2026-09-16T15:47:09Z,use_quota=True,user_id='f3caedfef2ea404790278fdda4660292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e77c87-72f6-4af7-9379-f6f7e490669e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e77c87-72f6-4af7-9379-f6f7e490669e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5b6d0d-1fec-44b4-be01-97674c1bd4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5b6d0d-1fec-44b4-be01-97674c1bd4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0381d0d1-89a8-4af1-8fdf-82c02ef915e1', 'volume_name': 'volume-0381d0d1-89a8-4af1-8fdf-82c02ef915e1', 'volume_size': 2, 'source_volid': '81953bc9-4c99-4a97-a6d1-81d98a5ae6ad', 'source_volstatus': 'available'}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7589fc-ba32-4ff8-86d7-2e046b6a9e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7589fc-ba32-4ff8-86d7-2e046b6a9e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a442115-bf58-4277-98ee-953300b3b6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:09 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Volume 0381d0d1-89a8-4af1-8fdf-82c02ef915e1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0381d0d1-89a8-4af1-8fdf-82c02ef915e1', 'volume_size': 2, 'source_volid': '81953bc9-4c99-4a97-a6d1-81d98a5ae6ad', 'source_volstatus': 'available'} Sep 16 17:47:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:09 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Cloning volume 81953bc9-4c99-4a97-a6d1-81d98a5ae6ad to volume 0381d0d1-89a8-4af1-8fdf-82c02ef915e1 Sep 16 17:47:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Creating offline snapshot a9460536-cc1f-4ec9-99bd-6be2a3494402 of volume 81953bc9-4c99-4a97-a6d1-81d98a5ae6ad {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:47:09 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1d1ca2-8cba-4e67-a4a2-40763e83c9b6]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:09 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad Sep 16 17:47:09 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:10 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad" returned: 0 in 0.425s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.a9460536-cc1f-4ec9-99bd-6be2a3494402 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:10 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.a9460536-cc1f-4ec9-99bd-6be2a3494402 1G Sep 16 17:47:10 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:10 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.a9460536-cc1f-4ec9-99bd-6be2a3494402 1G" returned: 0 in 0.473s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.a9460536-cc1f-4ec9-99bd-6be2a3494402 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:10 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.a9460536-cc1f-4ec9-99bd-6be2a3494402 Sep 16 17:47:10 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:10 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.a9460536-cc1f-4ec9-99bd-6be2a3494402" returned: 0 in 0.324s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:10 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.a9460536-cc1f-4ec9-99bd-6be2a3494402 is being set with open permissions: ugo+rw Sep 16 17:47:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.a9460536-cc1f-4ec9-99bd-6be2a3494402 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:10 devstack sudo[98076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.a9460536-cc1f-4ec9-99bd-6be2a3494402 Sep 16 17:47:10 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:11 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.a9460536-cc1f-4ec9-99bd-6be2a3494402" returned: 0 in 0.277s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:11 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.info Sep 16 17:47:11 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:11 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.info" returned: 0 in 0.279s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:11 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.info is being set with open permissions: ugo+rw Sep 16 17:47:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:11 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.info Sep 16 17:47:11 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:11 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.info" returned: 0 in 0.258s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:11 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Acquiring lock "cinder-quobyte-0381d0d1-89a8-4af1-8fdf-82c02ef915e1" by "_copy_volume_from_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:11 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Lock "cinder-quobyte-0381d0d1-89a8-4af1-8fdf-82c02ef915e1" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] snapshot: a9460536-cc1f-4ec9-99bd-6be2a3494402, volume: 0381d0d1-89a8-4af1-8fdf-82c02ef915e1, {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 17:47:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:47:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:47:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:11 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ac1c63-d872-4179-b0bd-b0edcdd8e617]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.a9460536-cc1f-4ec9-99bd-6be2a3494402 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:12 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.a9460536-cc1f-4ec9-99bd-6be2a3494402 Sep 16 17:47:12 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:12 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.a9460536-cc1f-4ec9-99bd-6be2a3494402" returned: 0 in 0.389s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:12 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:47:12 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70a5a47-1c2e-4997-bbbd-4ec094ddec72]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:12 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad Sep 16 17:47:12 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:12 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad" returned: 0 in 0.422s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:12 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 17:47:12 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Creating direct copy from snapshot {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 17:47:12 devstack cinder-volume[85899]: DEBUG cinder.utils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Path /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0381d0d1-89a8-4af1-8fdf-82c02ef915e1 not found in is_blk_device check {{(pid=85899) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 17:47:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0381d0d1-89a8-4af1-8fdf-82c02ef915e1 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:12 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0381d0d1-89a8-4af1-8fdf-82c02ef915e1 Sep 16 17:47:12 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:14 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:47:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Flow 'volume_create_manager' (0d3e8b39-e29b-4495-a004-e194ce628a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:47:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6723faa-e018-4ef6-8a5a-8a2a765e8b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6723faa-e018-4ef6-8a5a-8a2a765e8b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1512166499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e914f9a-5c66-4ddb-8993-35ab984d190f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4b5d41d7da449b914f60aa6013270c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:47:14Z,use_quota=True,user_id='5cbb06f7fd9a4d48adeb296bdf1a8d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e9c828-dee9-4984-8306-88e54ba39dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e9c828-dee9-4984-8306-88e54ba39dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c5783a-ffed-48f4-b6d2-2c76967bb791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c5783a-ffed-48f4-b6d2-2c76967bb791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e914f9a-5c66-4ddb-8993-35ab984d190f', 'volume_name': 'volume-9e914f9a-5c66-4ddb-8993-35ab984d190f', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b0d236-1cbd-44f1-84cb-81859d617f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b0d236-1cbd-44f1-84cb-81859d617f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ee55dd-a2e6-4f4f-b269-f9bcd53295d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:14 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Volume 9e914f9a-5c66-4ddb-8993-35ab984d190f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e914f9a-5c66-4ddb-8993-35ab984d190f', 'volume_size': 1} Sep 16 17:47:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:20 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0381d0d1-89a8-4af1-8fdf-82c02ef915e1" returned: 0 in 7.509s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:20 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Image conversion details: src /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad, size 1024.00 MB, duration 7.51 sec, destination /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0381d0d1-89a8-4af1-8fdf-82c02ef915e1 {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:47:20 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Converted 1024.00 MB image at 136.36 MB/s Sep 16 17:47:20 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0381d0d1-89a8-4af1-8fdf-82c02ef915e1 is being set with open permissions: ugo+rw Sep 16 17:47:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0381d0d1-89a8-4af1-8fdf-82c02ef915e1 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:20 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0381d0d1-89a8-4af1-8fdf-82c02ef915e1 Sep 16 17:47:20 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:20 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0381d0d1-89a8-4af1-8fdf-82c02ef915e1" returned: 0 in 0.253s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Lock "cinder-quobyte-0381d0d1-89a8-4af1-8fdf-82c02ef915e1" released by "_copy_volume_from_snapshot" :: held 8.665s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Acquiring lock "cinder-quobyte-a9460536-cc1f-4ec9-99bd-6be2a3494402" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Lock "cinder-quobyte-a9460536-cc1f-4ec9-99bd-6be2a3494402" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Deleting offline snapshot a9460536-cc1f-4ec9-99bd-6be2a3494402 of volume 81953bc9-4c99-4a97-a6d1-81d98a5ae6ad {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:47:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] snapshot_file for this snap is: volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.a9460536-cc1f-4ec9-99bd-6be2a3494402 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:47:20 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8017467-180c-4670-8443-cf9ddbaf7785]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.a9460536-cc1f-4ec9-99bd-6be2a3494402 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:20 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.a9460536-cc1f-4ec9-99bd-6be2a3494402 Sep 16 17:47:20 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:20 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.a9460536-cc1f-4ec9-99bd-6be2a3494402" returned: 0 in 0.371s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:47:20 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[16da3b88-a284-4dd8-8e05-d80a33b4b9c1]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:21 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad Sep 16 17:47:21 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:21 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad" returned: 0 in 0.526s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.a9460536-cc1f-4ec9-99bd-6be2a3494402 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:21 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.a9460536-cc1f-4ec9-99bd-6be2a3494402 Sep 16 17:47:21 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:21 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.a9460536-cc1f-4ec9-99bd-6be2a3494402" returned: 0 in 0.362s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.a9460536-cc1f-4ec9-99bd-6be2a3494402 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:21 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.a9460536-cc1f-4ec9-99bd-6be2a3494402 Sep 16 17:47:21 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:22 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad.a9460536-cc1f-4ec9-99bd-6be2a3494402" returned: 0 in 0.248s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Lock "cinder-quobyte-a9460536-cc1f-4ec9-99bd-6be2a3494402" released by "_delete_snapshot" :: held 1.607s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.517s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.804s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1512166499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e914f9a-5c66-4ddb-8993-35ab984d190f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4b5d41d7da449b914f60aa6013270c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:47:14Z,use_quota=True,user_id='5cbb06f7fd9a4d48adeb296bdf1a8d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:47:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Creating volume 9e914f9a-5c66-4ddb-8993-35ab984d190f {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:47:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:47:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:47:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:47:22 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:47:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a442115-bf58-4277-98ee-953300b3b6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0381d0d1-89a8-4af1-8fdf-82c02ef915e1', 'volume_size': 2, 'source_volid': '81953bc9-4c99-4a97-a6d1-81d98a5ae6ad', 'source_volstatus': 'available'}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:22 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f 1073741824 Sep 16 17:47:22 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (741b7e44-9403-4312-93ed-33554791a436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:22 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Volume volume-0381d0d1-89a8-4af1-8fdf-82c02ef915e1 (0381d0d1-89a8-4af1-8fdf-82c02ef915e1): created successfully Sep 16 17:47:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (741b7e44-9403-4312-93ed-33554791a436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Flow 'volume_create_manager' (014a49aa-bbc3-43a2-b923-248da49e3e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:47:22 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-bbe7d38e-e6d9-441d-bc7e-111b873588b3 tempest-VolumesCloneTest-410548931 None] Created volume successfully. Sep 16 17:47:22 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f 1073741824" returned: 0 in 0.454s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:22 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f Sep 16 17:47:22 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:22 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-32bafa44-3d3b-45a2-a6bf-babe1ebbed60 tempest-VolumesCloneTest-410548931 None] Acquiring lock "cinder-0381d0d1-89a8-4af1-8fdf-82c02ef915e1-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f" returned: 0 in 0.280s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:47:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ee55dd-a2e6-4f4f-b269-f9bcd53295d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e914f9a-5c66-4ddb-8993-35ab984d190f', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7571058c-9548-4f26-b0de-60f846e19970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-32bafa44-3d3b-45a2-a6bf-babe1ebbed60 tempest-VolumesCloneTest-410548931 None] Lock "cinder-0381d0d1-89a8-4af1-8fdf-82c02ef915e1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:23 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Volume volume-9e914f9a-5c66-4ddb-8993-35ab984d190f (9e914f9a-5c66-4ddb-8993-35ab984d190f): created successfully Sep 16 17:47:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7571058c-9548-4f26-b0de-60f846e19970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Flow 'volume_create_manager' (0d3e8b39-e29b-4495-a004-e194ce628a14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:47:23 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-6d76c70d-f84a-4875-b11f-de17bfc9af94 tempest-SnapshotsActionsTest-454657474 None] Created volume successfully. Sep 16 17:47:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-32bafa44-3d3b-45a2-a6bf-babe1ebbed60 tempest-VolumesCloneTest-410548931 None] Acquiring lock "cinder-quobyte-0381d0d1-89a8-4af1-8fdf-82c02ef915e1" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-32bafa44-3d3b-45a2-a6bf-babe1ebbed60 tempest-VolumesCloneTest-410548931 None] Lock "cinder-quobyte-0381d0d1-89a8-4af1-8fdf-82c02ef915e1" acquired by "delete_volume" :: waited 0.015s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:23 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[186b02b7-04c6-49ca-abf1-28f2daebaf50]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-32bafa44-3d3b-45a2-a6bf-babe1ebbed60 tempest-VolumesCloneTest-410548931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0381d0d1-89a8-4af1-8fdf-82c02ef915e1 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:23 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0381d0d1-89a8-4af1-8fdf-82c02ef915e1 Sep 16 17:47:23 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:23 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-32bafa44-3d3b-45a2-a6bf-babe1ebbed60 tempest-VolumesCloneTest-410548931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0381d0d1-89a8-4af1-8fdf-82c02ef915e1" returned: 0 in 0.341s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-32bafa44-3d3b-45a2-a6bf-babe1ebbed60 tempest-VolumesCloneTest-410548931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0381d0d1-89a8-4af1-8fdf-82c02ef915e1 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:23 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0381d0d1-89a8-4af1-8fdf-82c02ef915e1 Sep 16 17:47:23 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:23 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-32bafa44-3d3b-45a2-a6bf-babe1ebbed60 tempest-VolumesCloneTest-410548931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0381d0d1-89a8-4af1-8fdf-82c02ef915e1" returned: 0 in 0.236s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-32bafa44-3d3b-45a2-a6bf-babe1ebbed60 tempest-VolumesCloneTest-410548931 None] Lock "cinder-quobyte-0381d0d1-89a8-4af1-8fdf-82c02ef915e1" released by "delete_volume" :: held 0.615s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:23 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-32bafa44-3d3b-45a2-a6bf-babe1ebbed60 tempest-VolumesCloneTest-410548931 None] Created reservations ['4f1e5196-7729-431c-a034-2406247ac140', 'e89ab2d9-911b-4bb1-a56d-f4e5fce961ea', 'c28da7f9-3547-4812-b445-4f094f436e9b', 'd6119cc5-eefc-4625-8940-63760349f022'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:47:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-32bafa44-3d3b-45a2-a6bf-babe1ebbed60 tempest-VolumesCloneTest-410548931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-32bafa44-3d3b-45a2-a6bf-babe1ebbed60 tempest-VolumesCloneTest-410548931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-32bafa44-3d3b-45a2-a6bf-babe1ebbed60 tempest-VolumesCloneTest-410548931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:47:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-32bafa44-3d3b-45a2-a6bf-babe1ebbed60 tempest-VolumesCloneTest-410548931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:47:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-32bafa44-3d3b-45a2-a6bf-babe1ebbed60 tempest-VolumesCloneTest-410548931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-32bafa44-3d3b-45a2-a6bf-babe1ebbed60 tempest-VolumesCloneTest-410548931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:23 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:47:23 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:24 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-32bafa44-3d3b-45a2-a6bf-babe1ebbed60 tempest-VolumesCloneTest-410548931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.255s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:24 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-32bafa44-3d3b-45a2-a6bf-babe1ebbed60 tempest-VolumesCloneTest-410548931 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:47:24 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-32bafa44-3d3b-45a2-a6bf-babe1ebbed60 tempest-VolumesCloneTest-410548931 None] Deleted volume successfully. Sep 16 17:47:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-32bafa44-3d3b-45a2-a6bf-babe1ebbed60 tempest-VolumesCloneTest-410548931 None] Lock "cinder-0381d0d1-89a8-4af1-8fdf-82c02ef915e1-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cbb71a53-5a86-41ec-b069-8ee3baa62c89 tempest-SnapshotsActionsTest-454657474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cbb71a53-5a86-41ec-b069-8ee3baa62c89 tempest-SnapshotsActionsTest-454657474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-cbb71a53-5a86-41ec-b069-8ee3baa62c89 tempest-SnapshotsActionsTest-454657474 None] Creating offline snapshot c4d7ec10-d3e7-4508-8c50-39c5a3792e75 of volume 9e914f9a-5c66-4ddb-8993-35ab984d190f {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:47:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2087b106-bb1b-4234-a53c-defa1ae3bc85 tempest-VolumesCloneTest-410548931 None] Acquiring lock "cinder-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:24 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fc5fb7-f95f-4224-8f18-62f49d7fbbe5]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cbb71a53-5a86-41ec-b069-8ee3baa62c89 tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2087b106-bb1b-4234-a53c-defa1ae3bc85 tempest-VolumesCloneTest-410548931 None] Lock "cinder-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2087b106-bb1b-4234-a53c-defa1ae3bc85 tempest-VolumesCloneTest-410548931 None] Acquiring lock "cinder-quobyte-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2087b106-bb1b-4234-a53c-defa1ae3bc85 tempest-VolumesCloneTest-410548931 None] Lock "cinder-quobyte-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad" acquired by "delete_volume" :: waited 0.015s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:24 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2199d3ce-c1d3-4f5c-b03e-4d27c5ba7932]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2087b106-bb1b-4234-a53c-defa1ae3bc85 tempest-VolumesCloneTest-410548931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:24 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f Sep 16 17:47:24 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:24 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad Sep 16 17:47:24 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:24 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cbb71a53-5a86-41ec-b069-8ee3baa62c89 tempest-SnapshotsActionsTest-454657474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f" returned: 0 in 0.388s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cbb71a53-5a86-41ec-b069-8ee3baa62c89 tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:24 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 1G Sep 16 17:47:24 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:24 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2087b106-bb1b-4234-a53c-defa1ae3bc85 tempest-VolumesCloneTest-410548931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad" returned: 0 in 0.385s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2087b106-bb1b-4234-a53c-defa1ae3bc85 tempest-VolumesCloneTest-410548931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:24 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad Sep 16 17:47:24 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:25 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2087b106-bb1b-4234-a53c-defa1ae3bc85 tempest-VolumesCloneTest-410548931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad" returned: 0 in 0.272s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2087b106-bb1b-4234-a53c-defa1ae3bc85 tempest-VolumesCloneTest-410548931 None] Lock "cinder-quobyte-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad" released by "delete_volume" :: held 0.726s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:25 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cbb71a53-5a86-41ec-b069-8ee3baa62c89 tempest-SnapshotsActionsTest-454657474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 1G" returned: 0 in 0.428s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cbb71a53-5a86-41ec-b069-8ee3baa62c89 tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e914f9a-5c66-4ddb-8993-35ab984d190f -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:25 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e914f9a-5c66-4ddb-8993-35ab984d190f -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 Sep 16 17:47:25 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:25 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-2087b106-bb1b-4234-a53c-defa1ae3bc85 tempest-VolumesCloneTest-410548931 None] Created reservations ['89dfc583-21aa-42fd-915f-08e5a07e717c', 'c21c0008-184c-4a23-be04-68e13c781617', 'f2fab7c4-ce5d-4f6a-8342-4ed8e1e10807', 'fe046346-5339-4e16-99a8-1ab031e2f7ee'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:47:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2087b106-bb1b-4234-a53c-defa1ae3bc85 tempest-VolumesCloneTest-410548931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2087b106-bb1b-4234-a53c-defa1ae3bc85 tempest-VolumesCloneTest-410548931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2087b106-bb1b-4234-a53c-defa1ae3bc85 tempest-VolumesCloneTest-410548931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:47:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2087b106-bb1b-4234-a53c-defa1ae3bc85 tempest-VolumesCloneTest-410548931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:47:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2087b106-bb1b-4234-a53c-defa1ae3bc85 tempest-VolumesCloneTest-410548931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2087b106-bb1b-4234-a53c-defa1ae3bc85 tempest-VolumesCloneTest-410548931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:25 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:47:25 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:25 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cbb71a53-5a86-41ec-b069-8ee3baa62c89 tempest-SnapshotsActionsTest-454657474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e914f9a-5c66-4ddb-8993-35ab984d190f -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75" returned: 0 in 0.337s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:25 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-cbb71a53-5a86-41ec-b069-8ee3baa62c89 tempest-SnapshotsActionsTest-454657474 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 is being set with open permissions: ugo+rw Sep 16 17:47:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cbb71a53-5a86-41ec-b069-8ee3baa62c89 tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:25 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:25 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 Sep 16 17:47:25 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2087b106-bb1b-4234-a53c-defa1ae3bc85 tempest-VolumesCloneTest-410548931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.266s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:25 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-2087b106-bb1b-4234-a53c-defa1ae3bc85 tempest-VolumesCloneTest-410548931 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:47:25 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-2087b106-bb1b-4234-a53c-defa1ae3bc85 tempest-VolumesCloneTest-410548931 None] Deleted volume successfully. Sep 16 17:47:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2087b106-bb1b-4234-a53c-defa1ae3bc85 tempest-VolumesCloneTest-410548931 None] Lock "cinder-81953bc9-4c99-4a97-a6d1-81d98a5ae6ad-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:25 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cbb71a53-5a86-41ec-b069-8ee3baa62c89 tempest-SnapshotsActionsTest-454657474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75" returned: 0 in 0.280s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cbb71a53-5a86-41ec-b069-8ee3baa62c89 tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:25 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.info Sep 16 17:47:25 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:26 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cbb71a53-5a86-41ec-b069-8ee3baa62c89 tempest-SnapshotsActionsTest-454657474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.info" returned: 0 in 0.282s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:26 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-cbb71a53-5a86-41ec-b069-8ee3baa62c89 tempest-SnapshotsActionsTest-454657474 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.info is being set with open permissions: ugo+rw Sep 16 17:47:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cbb71a53-5a86-41ec-b069-8ee3baa62c89 tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:26 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.info Sep 16 17:47:26 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:26 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cbb71a53-5a86-41ec-b069-8ee3baa62c89 tempest-SnapshotsActionsTest-454657474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.info" returned: 0 in 0.273s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cbb71a53-5a86-41ec-b069-8ee3baa62c89 tempest-SnapshotsActionsTest-454657474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.106s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:26 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-cbb71a53-5a86-41ec-b069-8ee3baa62c89 tempest-SnapshotsActionsTest-454657474 None] Create snapshot completed successfully Sep 16 17:47:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7aa339d4-f85a-489e-8254-6ed76111bf9a tempest-SnapshotsActionsTest-454657474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7aa339d4-f85a-489e-8254-6ed76111bf9a tempest-SnapshotsActionsTest-454657474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-7aa339d4-f85a-489e-8254-6ed76111bf9a tempest-SnapshotsActionsTest-454657474 None] Creating offline snapshot 284a71a3-c63d-4cda-b3be-38a814bac677 of volume 9e914f9a-5c66-4ddb-8993-35ab984d190f {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:47:28 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae995a1-ea84-4ac0-be68-f2495967e549]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7aa339d4-f85a-489e-8254-6ed76111bf9a tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:28 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 Sep 16 17:47:28 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:28 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7aa339d4-f85a-489e-8254-6ed76111bf9a tempest-SnapshotsActionsTest-454657474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75" returned: 0 in 0.390s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-7aa339d4-f85a-489e-8254-6ed76111bf9a tempest-SnapshotsActionsTest-454657474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e914f9a-5c66-4ddb-8993-35ab984d190f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:47:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7aa339d4-f85a-489e-8254-6ed76111bf9a tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.284a71a3-c63d-4cda-b3be-38a814bac677 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:28 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.284a71a3-c63d-4cda-b3be-38a814bac677 1G Sep 16 17:47:28 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:28 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7aa339d4-f85a-489e-8254-6ed76111bf9a tempest-SnapshotsActionsTest-454657474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.284a71a3-c63d-4cda-b3be-38a814bac677 1G" returned: 0 in 0.519s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7aa339d4-f85a-489e-8254-6ed76111bf9a tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.284a71a3-c63d-4cda-b3be-38a814bac677 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:29 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.284a71a3-c63d-4cda-b3be-38a814bac677 Sep 16 17:47:29 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:29 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7aa339d4-f85a-489e-8254-6ed76111bf9a tempest-SnapshotsActionsTest-454657474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.284a71a3-c63d-4cda-b3be-38a814bac677" returned: 0 in 0.332s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:29 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-7aa339d4-f85a-489e-8254-6ed76111bf9a tempest-SnapshotsActionsTest-454657474 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.284a71a3-c63d-4cda-b3be-38a814bac677 is being set with open permissions: ugo+rw Sep 16 17:47:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7aa339d4-f85a-489e-8254-6ed76111bf9a tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.284a71a3-c63d-4cda-b3be-38a814bac677 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:29 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.284a71a3-c63d-4cda-b3be-38a814bac677 Sep 16 17:47:29 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:29 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7aa339d4-f85a-489e-8254-6ed76111bf9a tempest-SnapshotsActionsTest-454657474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.284a71a3-c63d-4cda-b3be-38a814bac677" returned: 0 in 0.273s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7aa339d4-f85a-489e-8254-6ed76111bf9a tempest-SnapshotsActionsTest-454657474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.618s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:29 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-7aa339d4-f85a-489e-8254-6ed76111bf9a tempest-SnapshotsActionsTest-454657474 None] Create snapshot completed successfully Sep 16 17:47:30 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f33fdf71-237a-4d2d-b93d-14751de0f379 tempest-SnapshotsActionsTest-463651682 None] Acquiring lock "cinder-284a71a3-c63d-4cda-b3be-38a814bac677-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:30 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f33fdf71-237a-4d2d-b93d-14751de0f379 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-284a71a3-c63d-4cda-b3be-38a814bac677-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:30 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f33fdf71-237a-4d2d-b93d-14751de0f379 tempest-SnapshotsActionsTest-463651682 None] Acquiring lock "cinder-quobyte-9e914f9a-5c66-4ddb-8993-35ab984d190f" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:30 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f33fdf71-237a-4d2d-b93d-14751de0f379 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-quobyte-9e914f9a-5c66-4ddb-8993-35ab984d190f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:30 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f33fdf71-237a-4d2d-b93d-14751de0f379 tempest-SnapshotsActionsTest-463651682 None] Acquiring lock "cinder-quobyte-284a71a3-c63d-4cda-b3be-38a814bac677" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:30 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f33fdf71-237a-4d2d-b93d-14751de0f379 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-quobyte-284a71a3-c63d-4cda-b3be-38a814bac677" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-f33fdf71-237a-4d2d-b93d-14751de0f379 tempest-SnapshotsActionsTest-463651682 None] Deleting offline snapshot 284a71a3-c63d-4cda-b3be-38a814bac677 of volume 9e914f9a-5c66-4ddb-8993-35ab984d190f {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:47:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-f33fdf71-237a-4d2d-b93d-14751de0f379 tempest-SnapshotsActionsTest-463651682 None] snapshot_file for this snap is: volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.284a71a3-c63d-4cda-b3be-38a814bac677 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:47:30 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b49e0e-8d8a-480a-a80b-100ba0b42d23]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f33fdf71-237a-4d2d-b93d-14751de0f379 tempest-SnapshotsActionsTest-463651682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.284a71a3-c63d-4cda-b3be-38a814bac677 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:30 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.284a71a3-c63d-4cda-b3be-38a814bac677 Sep 16 17:47:30 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:30 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f33fdf71-237a-4d2d-b93d-14751de0f379 tempest-SnapshotsActionsTest-463651682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.284a71a3-c63d-4cda-b3be-38a814bac677" returned: 0 in 0.406s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-f33fdf71-237a-4d2d-b93d-14751de0f379 tempest-SnapshotsActionsTest-463651682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e914f9a-5c66-4ddb-8993-35ab984d190f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:47:30 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed359e25-308c-4835-b137-4b9c6d949c1f]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f33fdf71-237a-4d2d-b93d-14751de0f379 tempest-SnapshotsActionsTest-463651682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:30 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 Sep 16 17:47:30 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:31 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f33fdf71-237a-4d2d-b93d-14751de0f379 tempest-SnapshotsActionsTest-463651682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75" returned: 0 in 0.433s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:31 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-f33fdf71-237a-4d2d-b93d-14751de0f379 tempest-SnapshotsActionsTest-463651682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e914f9a-5c66-4ddb-8993-35ab984d190f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:47:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f33fdf71-237a-4d2d-b93d-14751de0f379 tempest-SnapshotsActionsTest-463651682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.284a71a3-c63d-4cda-b3be-38a814bac677 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:31 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.284a71a3-c63d-4cda-b3be-38a814bac677 Sep 16 17:47:31 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:31 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f33fdf71-237a-4d2d-b93d-14751de0f379 tempest-SnapshotsActionsTest-463651682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.284a71a3-c63d-4cda-b3be-38a814bac677" returned: 0 in 0.478s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f33fdf71-237a-4d2d-b93d-14751de0f379 tempest-SnapshotsActionsTest-463651682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.284a71a3-c63d-4cda-b3be-38a814bac677 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:31 devstack sudo[98265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.284a71a3-c63d-4cda-b3be-38a814bac677 Sep 16 17:47:31 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:31 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f33fdf71-237a-4d2d-b93d-14751de0f379 tempest-SnapshotsActionsTest-463651682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.284a71a3-c63d-4cda-b3be-38a814bac677" returned: 0 in 0.259s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f33fdf71-237a-4d2d-b93d-14751de0f379 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-quobyte-284a71a3-c63d-4cda-b3be-38a814bac677" released by "_delete_snapshot" :: held 1.692s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f33fdf71-237a-4d2d-b93d-14751de0f379 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-quobyte-9e914f9a-5c66-4ddb-8993-35ab984d190f" released by "delete_snapshot" :: held 1.717s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:32 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-f33fdf71-237a-4d2d-b93d-14751de0f379 tempest-SnapshotsActionsTest-463651682 None] Created reservations ['7a887a0b-797f-40a8-a07e-dd927b7f699e', '7c5f78b7-17bf-45de-83eb-1e74ce858c18', 'ebf248f8-766a-49b6-b90e-5c65cf600a8d', 'f5150409-5957-457e-960d-013902445c7d'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:47:32 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-f33fdf71-237a-4d2d-b93d-14751de0f379 tempest-SnapshotsActionsTest-463651682 None] Delete snapshot completed successfully. Sep 16 17:47:32 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f33fdf71-237a-4d2d-b93d-14751de0f379 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-284a71a3-c63d-4cda-b3be-38a814bac677-delete_snapshot" released by "delete_snapshot" :: held 1.864s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ba9bfb64-d126-4bd3-bbe1-37f59d0ae7f0 tempest-SnapshotsActionsTest-454657474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ba9bfb64-d126-4bd3-bbe1-37f59d0ae7f0 tempest-SnapshotsActionsTest-454657474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-ba9bfb64-d126-4bd3-bbe1-37f59d0ae7f0 tempest-SnapshotsActionsTest-454657474 None] Creating offline snapshot 1633f871-74b5-401e-9820-7fad700fdcfb of volume 9e914f9a-5c66-4ddb-8993-35ab984d190f {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:47:32 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4e9b4a-4f07-4276-bbc9-9ef6d7added6]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ba9bfb64-d126-4bd3-bbe1-37f59d0ae7f0 tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:32 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 Sep 16 17:47:32 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:33 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ba9bfb64-d126-4bd3-bbe1-37f59d0ae7f0 tempest-SnapshotsActionsTest-454657474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75" returned: 0 in 0.412s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-ba9bfb64-d126-4bd3-bbe1-37f59d0ae7f0 tempest-SnapshotsActionsTest-454657474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e914f9a-5c66-4ddb-8993-35ab984d190f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:47:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ba9bfb64-d126-4bd3-bbe1-37f59d0ae7f0 tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.1633f871-74b5-401e-9820-7fad700fdcfb 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:33 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.1633f871-74b5-401e-9820-7fad700fdcfb 1G Sep 16 17:47:33 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:33 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ba9bfb64-d126-4bd3-bbe1-37f59d0ae7f0 tempest-SnapshotsActionsTest-454657474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.1633f871-74b5-401e-9820-7fad700fdcfb 1G" returned: 0 in 0.558s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ba9bfb64-d126-4bd3-bbe1-37f59d0ae7f0 tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.1633f871-74b5-401e-9820-7fad700fdcfb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:33 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.1633f871-74b5-401e-9820-7fad700fdcfb Sep 16 17:47:33 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:34 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ba9bfb64-d126-4bd3-bbe1-37f59d0ae7f0 tempest-SnapshotsActionsTest-454657474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.1633f871-74b5-401e-9820-7fad700fdcfb" returned: 0 in 0.361s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:34 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-ba9bfb64-d126-4bd3-bbe1-37f59d0ae7f0 tempest-SnapshotsActionsTest-454657474 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.1633f871-74b5-401e-9820-7fad700fdcfb is being set with open permissions: ugo+rw Sep 16 17:47:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ba9bfb64-d126-4bd3-bbe1-37f59d0ae7f0 tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.1633f871-74b5-401e-9820-7fad700fdcfb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:34 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.1633f871-74b5-401e-9820-7fad700fdcfb Sep 16 17:47:34 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:34 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ba9bfb64-d126-4bd3-bbe1-37f59d0ae7f0 tempest-SnapshotsActionsTest-454657474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.1633f871-74b5-401e-9820-7fad700fdcfb" returned: 0 in 0.280s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ba9bfb64-d126-4bd3-bbe1-37f59d0ae7f0 tempest-SnapshotsActionsTest-454657474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.733s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:34 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-ba9bfb64-d126-4bd3-bbe1-37f59d0ae7f0 tempest-SnapshotsActionsTest-454657474 None] Create snapshot completed successfully Sep 16 17:47:35 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c013afb1-5cbf-4037-9cde-aa5376a34738 tempest-SnapshotsActionsTest-463651682 None] Acquiring lock "cinder-1633f871-74b5-401e-9820-7fad700fdcfb-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:35 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c013afb1-5cbf-4037-9cde-aa5376a34738 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-1633f871-74b5-401e-9820-7fad700fdcfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:35 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c013afb1-5cbf-4037-9cde-aa5376a34738 tempest-SnapshotsActionsTest-463651682 None] Acquiring lock "cinder-quobyte-9e914f9a-5c66-4ddb-8993-35ab984d190f" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:35 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c013afb1-5cbf-4037-9cde-aa5376a34738 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-quobyte-9e914f9a-5c66-4ddb-8993-35ab984d190f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:35 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c013afb1-5cbf-4037-9cde-aa5376a34738 tempest-SnapshotsActionsTest-463651682 None] Acquiring lock "cinder-quobyte-1633f871-74b5-401e-9820-7fad700fdcfb" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:35 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c013afb1-5cbf-4037-9cde-aa5376a34738 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-quobyte-1633f871-74b5-401e-9820-7fad700fdcfb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-c013afb1-5cbf-4037-9cde-aa5376a34738 tempest-SnapshotsActionsTest-463651682 None] Deleting offline snapshot 1633f871-74b5-401e-9820-7fad700fdcfb of volume 9e914f9a-5c66-4ddb-8993-35ab984d190f {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:47:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-c013afb1-5cbf-4037-9cde-aa5376a34738 tempest-SnapshotsActionsTest-463651682 None] snapshot_file for this snap is: volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.1633f871-74b5-401e-9820-7fad700fdcfb {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:47:35 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d51edf4-57bb-440a-acb6-a90baef971db]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c013afb1-5cbf-4037-9cde-aa5376a34738 tempest-SnapshotsActionsTest-463651682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.1633f871-74b5-401e-9820-7fad700fdcfb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:35 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.1633f871-74b5-401e-9820-7fad700fdcfb Sep 16 17:47:35 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:35 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c013afb1-5cbf-4037-9cde-aa5376a34738 tempest-SnapshotsActionsTest-463651682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.1633f871-74b5-401e-9820-7fad700fdcfb" returned: 0 in 0.436s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-c013afb1-5cbf-4037-9cde-aa5376a34738 tempest-SnapshotsActionsTest-463651682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e914f9a-5c66-4ddb-8993-35ab984d190f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:47:35 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdbc17a-9c58-4d06-b42d-a319cb6554a6]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c013afb1-5cbf-4037-9cde-aa5376a34738 tempest-SnapshotsActionsTest-463651682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:35 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 Sep 16 17:47:35 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:36 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c013afb1-5cbf-4037-9cde-aa5376a34738 tempest-SnapshotsActionsTest-463651682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75" returned: 0 in 0.454s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:36 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-c013afb1-5cbf-4037-9cde-aa5376a34738 tempest-SnapshotsActionsTest-463651682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e914f9a-5c66-4ddb-8993-35ab984d190f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:47:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c013afb1-5cbf-4037-9cde-aa5376a34738 tempest-SnapshotsActionsTest-463651682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.1633f871-74b5-401e-9820-7fad700fdcfb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:36 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.1633f871-74b5-401e-9820-7fad700fdcfb Sep 16 17:47:36 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:36 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c013afb1-5cbf-4037-9cde-aa5376a34738 tempest-SnapshotsActionsTest-463651682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.1633f871-74b5-401e-9820-7fad700fdcfb" returned: 0 in 0.415s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c013afb1-5cbf-4037-9cde-aa5376a34738 tempest-SnapshotsActionsTest-463651682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.1633f871-74b5-401e-9820-7fad700fdcfb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:36 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.1633f871-74b5-401e-9820-7fad700fdcfb Sep 16 17:47:36 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:36 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c013afb1-5cbf-4037-9cde-aa5376a34738 tempest-SnapshotsActionsTest-463651682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.1633f871-74b5-401e-9820-7fad700fdcfb" returned: 0 in 0.245s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c013afb1-5cbf-4037-9cde-aa5376a34738 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-quobyte-1633f871-74b5-401e-9820-7fad700fdcfb" released by "_delete_snapshot" :: held 1.666s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c013afb1-5cbf-4037-9cde-aa5376a34738 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-quobyte-9e914f9a-5c66-4ddb-8993-35ab984d190f" released by "delete_snapshot" :: held 1.689s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:36 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-c013afb1-5cbf-4037-9cde-aa5376a34738 tempest-SnapshotsActionsTest-463651682 None] Created reservations ['23706e7c-a29a-4efe-8a3e-7a12a2fef699', '9adce8c8-c717-4ce4-9ecd-fc4bb6bc27e2', '25b6f3fb-00de-4122-8a19-405f2a18a70f', 'a74a4595-04ed-4acf-a4c4-b98fa67bd894'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:47:36 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-c013afb1-5cbf-4037-9cde-aa5376a34738 tempest-SnapshotsActionsTest-463651682 None] Delete snapshot completed successfully. Sep 16 17:47:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c013afb1-5cbf-4037-9cde-aa5376a34738 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-1633f871-74b5-401e-9820-7fad700fdcfb-delete_snapshot" released by "delete_snapshot" :: held 1.827s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Flow 'volume_create_manager' (108471c1-c724-4e25-8410-7aa241963154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b440e0db-819a-4237-89f8-c4a113f2fe58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b440e0db-819a-4237-89f8-c4a113f2fe58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-880924931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5334f223-3b46-4997-a403-6dd28b255aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9edd60c220492a9a4fa67a420c98e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:47:37Z,use_quota=True,user_id='b581d156dc9245a1bf752ff684cc4bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0faddcbc-5e7f-4d20-a895-b64903ab3f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0faddcbc-5e7f-4d20-a895-b64903ab3f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb56139-ce3b-48e5-8eb3-3bb224b1c8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb56139-ce3b-48e5-8eb3-3bb224b1c8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5334f223-3b46-4997-a403-6dd28b255aec', 'volume_name': 'volume-5334f223-3b46-4997-a403-6dd28b255aec', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16740d00-cabf-40c6-9e32-08edc687b4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16740d00-cabf-40c6-9e32-08edc687b4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18205917-7e41-484f-9127-386a2477fd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:37 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Volume 5334f223-3b46-4997-a403-6dd28b255aec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5334f223-3b46-4997-a403-6dd28b255aec', 'volume_size': 1} Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-880924931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5334f223-3b46-4997-a403-6dd28b255aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9edd60c220492a9a4fa67a420c98e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:47:37Z,use_quota=True,user_id='b581d156dc9245a1bf752ff684cc4bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Creating volume 5334f223-3b46-4997-a403-6dd28b255aec {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:47:37 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:37 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec 1073741824 Sep 16 17:47:37 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ea4f2cd2-16c4-43f1-93f2-ffe531908b92 tempest-SnapshotsActionsTest-454657474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:37 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec 1073741824" returned: 0 in 0.407s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:37 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec Sep 16 17:47:37 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:38 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec" returned: 0 in 0.236s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:47:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ea4f2cd2-16c4-43f1-93f2-ffe531908b92 tempest-SnapshotsActionsTest-454657474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.640s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18205917-7e41-484f-9127-386a2477fd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5334f223-3b46-4997-a403-6dd28b255aec', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42218cc6-88ef-441c-b38e-4c091ead0d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-ea4f2cd2-16c4-43f1-93f2-ffe531908b92 tempest-SnapshotsActionsTest-454657474 None] Creating offline snapshot cdef11c2-d7f3-491c-8396-e9f9a1e116f2 of volume 9e914f9a-5c66-4ddb-8993-35ab984d190f {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:47:38 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Volume volume-5334f223-3b46-4997-a403-6dd28b255aec (5334f223-3b46-4997-a403-6dd28b255aec): created successfully Sep 16 17:47:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42218cc6-88ef-441c-b38e-4c091ead0d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Flow 'volume_create_manager' (108471c1-c724-4e25-8410-7aa241963154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:47:38 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5752344f-72af-463e-ae38-6d46cba1bf9f]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ea4f2cd2-16c4-43f1-93f2-ffe531908b92 tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:38 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-9f3ba202-6429-42b6-ad12-fdd3d54c1eb5 tempest-VolumesSnapshotTestJSON-77441170 None] Created volume successfully. Sep 16 17:47:38 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 Sep 16 17:47:38 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:38 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ea4f2cd2-16c4-43f1-93f2-ffe531908b92 tempest-SnapshotsActionsTest-454657474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75" returned: 0 in 0.409s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-ea4f2cd2-16c4-43f1-93f2-ffe531908b92 tempest-SnapshotsActionsTest-454657474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e914f9a-5c66-4ddb-8993-35ab984d190f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:47:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ea4f2cd2-16c4-43f1-93f2-ffe531908b92 tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.cdef11c2-d7f3-491c-8396-e9f9a1e116f2 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:38 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.cdef11c2-d7f3-491c-8396-e9f9a1e116f2 1G Sep 16 17:47:38 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f164b980-148c-40e3-8588-9d3068e1f300 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:39 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ea4f2cd2-16c4-43f1-93f2-ffe531908b92 tempest-SnapshotsActionsTest-454657474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.cdef11c2-d7f3-491c-8396-e9f9a1e116f2 1G" returned: 0 in 0.416s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ea4f2cd2-16c4-43f1-93f2-ffe531908b92 tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.cdef11c2-d7f3-491c-8396-e9f9a1e116f2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:39 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.cdef11c2-d7f3-491c-8396-e9f9a1e116f2 Sep 16 17:47:39 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:39 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ea4f2cd2-16c4-43f1-93f2-ffe531908b92 tempest-SnapshotsActionsTest-454657474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.cdef11c2-d7f3-491c-8396-e9f9a1e116f2" returned: 0 in 0.274s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:39 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-ea4f2cd2-16c4-43f1-93f2-ffe531908b92 tempest-SnapshotsActionsTest-454657474 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.cdef11c2-d7f3-491c-8396-e9f9a1e116f2 is being set with open permissions: ugo+rw Sep 16 17:47:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ea4f2cd2-16c4-43f1-93f2-ffe531908b92 tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.cdef11c2-d7f3-491c-8396-e9f9a1e116f2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:39 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.cdef11c2-d7f3-491c-8396-e9f9a1e116f2 Sep 16 17:47:39 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:39 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ea4f2cd2-16c4-43f1-93f2-ffe531908b92 tempest-SnapshotsActionsTest-454657474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.cdef11c2-d7f3-491c-8396-e9f9a1e116f2" returned: 0 in 0.246s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ea4f2cd2-16c4-43f1-93f2-ffe531908b92 tempest-SnapshotsActionsTest-454657474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.471s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f164b980-148c-40e3-8588-9d3068e1f300 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.931s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-f164b980-148c-40e3-8588-9d3068e1f300 tempest-VolumesSnapshotTestJSON-77441170 None] Creating offline snapshot 7f76a45b-5cca-4ba9-8017-9b1130694d92 of volume 5334f223-3b46-4997-a403-6dd28b255aec {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:47:39 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-ea4f2cd2-16c4-43f1-93f2-ffe531908b92 tempest-SnapshotsActionsTest-454657474 None] Create snapshot completed successfully Sep 16 17:47:39 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4772d95-a052-4ff4-85a4-914f9472df58]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f164b980-148c-40e3-8588-9d3068e1f300 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:39 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec Sep 16 17:47:39 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:40 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f164b980-148c-40e3-8588-9d3068e1f300 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec" returned: 0 in 0.382s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f164b980-148c-40e3-8588-9d3068e1f300 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.7f76a45b-5cca-4ba9-8017-9b1130694d92 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:40 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.7f76a45b-5cca-4ba9-8017-9b1130694d92 1G Sep 16 17:47:40 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:40 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f164b980-148c-40e3-8588-9d3068e1f300 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.7f76a45b-5cca-4ba9-8017-9b1130694d92 1G" returned: 0 in 0.397s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f164b980-148c-40e3-8588-9d3068e1f300 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5334f223-3b46-4997-a403-6dd28b255aec -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.7f76a45b-5cca-4ba9-8017-9b1130694d92 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:40 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5334f223-3b46-4997-a403-6dd28b255aec -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.7f76a45b-5cca-4ba9-8017-9b1130694d92 Sep 16 17:47:40 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:40 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-86627680-a14b-497e-897d-ca3255001d91 tempest-SnapshotsActionsTest-463651682 None] Acquiring lock "cinder-cdef11c2-d7f3-491c-8396-e9f9a1e116f2-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:40 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-86627680-a14b-497e-897d-ca3255001d91 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-cdef11c2-d7f3-491c-8396-e9f9a1e116f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:40 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-86627680-a14b-497e-897d-ca3255001d91 tempest-SnapshotsActionsTest-463651682 None] Acquiring lock "cinder-quobyte-9e914f9a-5c66-4ddb-8993-35ab984d190f" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:40 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-86627680-a14b-497e-897d-ca3255001d91 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-quobyte-9e914f9a-5c66-4ddb-8993-35ab984d190f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:40 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-86627680-a14b-497e-897d-ca3255001d91 tempest-SnapshotsActionsTest-463651682 None] Acquiring lock "cinder-quobyte-cdef11c2-d7f3-491c-8396-e9f9a1e116f2" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:40 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:40 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-86627680-a14b-497e-897d-ca3255001d91 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-quobyte-cdef11c2-d7f3-491c-8396-e9f9a1e116f2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-86627680-a14b-497e-897d-ca3255001d91 tempest-SnapshotsActionsTest-463651682 None] Deleting offline snapshot cdef11c2-d7f3-491c-8396-e9f9a1e116f2 of volume 9e914f9a-5c66-4ddb-8993-35ab984d190f {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:47:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-86627680-a14b-497e-897d-ca3255001d91 tempest-SnapshotsActionsTest-463651682 None] snapshot_file for this snap is: volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.cdef11c2-d7f3-491c-8396-e9f9a1e116f2 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:47:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f164b980-148c-40e3-8588-9d3068e1f300 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5334f223-3b46-4997-a403-6dd28b255aec -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.7f76a45b-5cca-4ba9-8017-9b1130694d92" returned: 0 in 0.342s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:40 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-f164b980-148c-40e3-8588-9d3068e1f300 tempest-VolumesSnapshotTestJSON-77441170 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.7f76a45b-5cca-4ba9-8017-9b1130694d92 is being set with open permissions: ugo+rw Sep 16 17:47:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f164b980-148c-40e3-8588-9d3068e1f300 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.7f76a45b-5cca-4ba9-8017-9b1130694d92 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:40 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa496658-df6d-4009-8b1a-fdcfd94ae880]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-86627680-a14b-497e-897d-ca3255001d91 tempest-SnapshotsActionsTest-463651682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.cdef11c2-d7f3-491c-8396-e9f9a1e116f2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:40 devstack sudo[98386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.7f76a45b-5cca-4ba9-8017-9b1130694d92 Sep 16 17:47:40 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:40 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.cdef11c2-d7f3-491c-8396-e9f9a1e116f2 Sep 16 17:47:40 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:41 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f164b980-148c-40e3-8588-9d3068e1f300 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.7f76a45b-5cca-4ba9-8017-9b1130694d92" returned: 0 in 0.260s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f164b980-148c-40e3-8588-9d3068e1f300 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:41 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.info Sep 16 17:47:41 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:41 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-86627680-a14b-497e-897d-ca3255001d91 tempest-SnapshotsActionsTest-463651682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.cdef11c2-d7f3-491c-8396-e9f9a1e116f2" returned: 0 in 0.382s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:41 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-86627680-a14b-497e-897d-ca3255001d91 tempest-SnapshotsActionsTest-463651682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e914f9a-5c66-4ddb-8993-35ab984d190f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:47:41 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8127c34-0fba-4201-91e1-8002a2452e19]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-86627680-a14b-497e-897d-ca3255001d91 tempest-SnapshotsActionsTest-463651682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:41 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 Sep 16 17:47:41 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:41 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f164b980-148c-40e3-8588-9d3068e1f300 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.info" returned: 0 in 0.273s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:41 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-f164b980-148c-40e3-8588-9d3068e1f300 tempest-VolumesSnapshotTestJSON-77441170 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.info is being set with open permissions: ugo+rw Sep 16 17:47:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f164b980-148c-40e3-8588-9d3068e1f300 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:41 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.info Sep 16 17:47:41 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:41 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-86627680-a14b-497e-897d-ca3255001d91 tempest-SnapshotsActionsTest-463651682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75" returned: 0 in 0.417s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:41 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-86627680-a14b-497e-897d-ca3255001d91 tempest-SnapshotsActionsTest-463651682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e914f9a-5c66-4ddb-8993-35ab984d190f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:47:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-86627680-a14b-497e-897d-ca3255001d91 tempest-SnapshotsActionsTest-463651682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.cdef11c2-d7f3-491c-8396-e9f9a1e116f2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:41 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f164b980-148c-40e3-8588-9d3068e1f300 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.info" returned: 0 in 0.291s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:41 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.cdef11c2-d7f3-491c-8396-e9f9a1e116f2 Sep 16 17:47:41 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f164b980-148c-40e3-8588-9d3068e1f300 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:41 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-f164b980-148c-40e3-8588-9d3068e1f300 tempest-VolumesSnapshotTestJSON-77441170 None] Create snapshot completed successfully Sep 16 17:47:42 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-86627680-a14b-497e-897d-ca3255001d91 tempest-SnapshotsActionsTest-463651682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.cdef11c2-d7f3-491c-8396-e9f9a1e116f2" returned: 0 in 0.420s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-86627680-a14b-497e-897d-ca3255001d91 tempest-SnapshotsActionsTest-463651682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.cdef11c2-d7f3-491c-8396-e9f9a1e116f2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:42 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.cdef11c2-d7f3-491c-8396-e9f9a1e116f2 Sep 16 17:47:42 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7745ba4f-ea41-4241-9af8-041de9bbbdcb tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "cinder-7f76a45b-5cca-4ba9-8017-9b1130694d92-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7745ba4f-ea41-4241-9af8-041de9bbbdcb tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-7f76a45b-5cca-4ba9-8017-9b1130694d92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7745ba4f-ea41-4241-9af8-041de9bbbdcb tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "cinder-quobyte-5334f223-3b46-4997-a403-6dd28b255aec" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7745ba4f-ea41-4241-9af8-041de9bbbdcb tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-5334f223-3b46-4997-a403-6dd28b255aec" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7745ba4f-ea41-4241-9af8-041de9bbbdcb tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "cinder-quobyte-7f76a45b-5cca-4ba9-8017-9b1130694d92" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:42 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-86627680-a14b-497e-897d-ca3255001d91 tempest-SnapshotsActionsTest-463651682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.cdef11c2-d7f3-491c-8396-e9f9a1e116f2" returned: 0 in 0.362s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-86627680-a14b-497e-897d-ca3255001d91 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-quobyte-cdef11c2-d7f3-491c-8396-e9f9a1e116f2" released by "_delete_snapshot" :: held 1.720s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7745ba4f-ea41-4241-9af8-041de9bbbdcb tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-7f76a45b-5cca-4ba9-8017-9b1130694d92" acquired by "_delete_snapshot" :: waited 0.080s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-7745ba4f-ea41-4241-9af8-041de9bbbdcb tempest-VolumesSnapshotTestJSON-77441170 None] Deleting offline snapshot 7f76a45b-5cca-4ba9-8017-9b1130694d92 of volume 5334f223-3b46-4997-a403-6dd28b255aec {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:47:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-7745ba4f-ea41-4241-9af8-041de9bbbdcb tempest-VolumesSnapshotTestJSON-77441170 None] snapshot_file for this snap is: volume-5334f223-3b46-4997-a403-6dd28b255aec.7f76a45b-5cca-4ba9-8017-9b1130694d92 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:47:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-86627680-a14b-497e-897d-ca3255001d91 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-quobyte-9e914f9a-5c66-4ddb-8993-35ab984d190f" released by "delete_snapshot" :: held 1.784s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:42 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a251ce69-a06e-4559-bf84-dfe423c82b63]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7745ba4f-ea41-4241-9af8-041de9bbbdcb tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.7f76a45b-5cca-4ba9-8017-9b1130694d92 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:42 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-86627680-a14b-497e-897d-ca3255001d91 tempest-SnapshotsActionsTest-463651682 None] Created reservations ['af634ec9-f5f2-48dd-a895-932c62244557', 'cd48e6b3-5a3b-422e-8463-a42f8063bc2a', 'f53a7873-4214-41d5-9ef0-7d47fdc759bc', '551aeacf-1076-42df-9dbe-41b18a32b89f'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:47:42 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-86627680-a14b-497e-897d-ca3255001d91 tempest-SnapshotsActionsTest-463651682 None] Delete snapshot completed successfully. Sep 16 17:47:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-86627680-a14b-497e-897d-ca3255001d91 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-cdef11c2-d7f3-491c-8396-e9f9a1e116f2-delete_snapshot" released by "delete_snapshot" :: held 1.984s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:42 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.7f76a45b-5cca-4ba9-8017-9b1130694d92 Sep 16 17:47:42 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:43 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7745ba4f-ea41-4241-9af8-041de9bbbdcb tempest-VolumesSnapshotTestJSON-77441170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.7f76a45b-5cca-4ba9-8017-9b1130694d92" returned: 0 in 0.686s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-7745ba4f-ea41-4241-9af8-041de9bbbdcb tempest-VolumesSnapshotTestJSON-77441170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5334f223-3b46-4997-a403-6dd28b255aec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:47:43 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7423b13a-f711-4ad4-9d93-15b5ee14fab4]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7745ba4f-ea41-4241-9af8-041de9bbbdcb tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bcc9f86d-decd-4b65-b8a1-08e257a20c6d tempest-SnapshotsActionsTest-454657474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bcc9f86d-decd-4b65-b8a1-08e257a20c6d tempest-SnapshotsActionsTest-454657474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-bcc9f86d-decd-4b65-b8a1-08e257a20c6d tempest-SnapshotsActionsTest-454657474 None] Creating offline snapshot 9ef44d38-218e-4898-be9e-31aa3ccecf1f of volume 9e914f9a-5c66-4ddb-8993-35ab984d190f {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:47:43 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec Sep 16 17:47:43 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:43 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5ebccc-e39d-4d11-8038-6ee8030ec530]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bcc9f86d-decd-4b65-b8a1-08e257a20c6d tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:43 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 Sep 16 17:47:43 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:43 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7745ba4f-ea41-4241-9af8-041de9bbbdcb tempest-VolumesSnapshotTestJSON-77441170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec" returned: 0 in 0.461s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7745ba4f-ea41-4241-9af8-041de9bbbdcb tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.7f76a45b-5cca-4ba9-8017-9b1130694d92 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:43 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.7f76a45b-5cca-4ba9-8017-9b1130694d92 Sep 16 17:47:43 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:44 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bcc9f86d-decd-4b65-b8a1-08e257a20c6d tempest-SnapshotsActionsTest-454657474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75" returned: 0 in 0.479s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-bcc9f86d-decd-4b65-b8a1-08e257a20c6d tempest-SnapshotsActionsTest-454657474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e914f9a-5c66-4ddb-8993-35ab984d190f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:47:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bcc9f86d-decd-4b65-b8a1-08e257a20c6d tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.9ef44d38-218e-4898-be9e-31aa3ccecf1f 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:44 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.9ef44d38-218e-4898-be9e-31aa3ccecf1f 1G Sep 16 17:47:44 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:44 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7745ba4f-ea41-4241-9af8-041de9bbbdcb tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.7f76a45b-5cca-4ba9-8017-9b1130694d92" returned: 0 in 0.462s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7745ba4f-ea41-4241-9af8-041de9bbbdcb tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.7f76a45b-5cca-4ba9-8017-9b1130694d92 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:44 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.7f76a45b-5cca-4ba9-8017-9b1130694d92 Sep 16 17:47:44 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:44 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-fad7105a-e6d9-40fe-af0a-b44240a1bf0a req-ba882065-383e-4917-842f-0d7b5202b765 tempest-TestShelveInstance-484011381 None] Terminate volume connection completed successfully. Sep 16 17:47:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-fad7105a-e6d9-40fe-af0a-b44240a1bf0a req-ba882065-383e-4917-842f-0d7b5202b765 tempest-TestShelveInstance-484011381 None] Deleting attachment 4e2a093c-c70b-4c2a-be86-299a5948a638. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:47:44 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7745ba4f-ea41-4241-9af8-041de9bbbdcb tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec.7f76a45b-5cca-4ba9-8017-9b1130694d92" returned: 0 in 0.303s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7745ba4f-ea41-4241-9af8-041de9bbbdcb tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-7f76a45b-5cca-4ba9-8017-9b1130694d92" released by "_delete_snapshot" :: held 2.071s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7745ba4f-ea41-4241-9af8-041de9bbbdcb tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-5334f223-3b46-4997-a403-6dd28b255aec" released by "delete_snapshot" :: held 2.161s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:44 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bcc9f86d-decd-4b65-b8a1-08e257a20c6d tempest-SnapshotsActionsTest-454657474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.9ef44d38-218e-4898-be9e-31aa3ccecf1f 1G" returned: 0 in 0.616s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bcc9f86d-decd-4b65-b8a1-08e257a20c6d tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.9ef44d38-218e-4898-be9e-31aa3ccecf1f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:44 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.9ef44d38-218e-4898-be9e-31aa3ccecf1f Sep 16 17:47:44 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-fad7105a-e6d9-40fe-af0a-b44240a1bf0a req-04dfbecd-4885-4251-b4c9-ac962ac0a652 tempest-TestShelveInstance-484011381 None] Acquiring lock "cinder-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:44 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-7745ba4f-ea41-4241-9af8-041de9bbbdcb tempest-VolumesSnapshotTestJSON-77441170 None] Created reservations ['caad0cd9-2898-4988-b39b-2142134fd1d0', 'd5990fab-2543-4d49-bdfe-46beeead8f14', 'ea59f92b-67ae-4284-8776-aa3d96b8113a', '5651d577-8835-44a6-9181-eeb5a66953ef'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:47:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-fad7105a-e6d9-40fe-af0a-b44240a1bf0a req-04dfbecd-4885-4251-b4c9-ac962ac0a652 tempest-TestShelveInstance-484011381 None] Lock "cinder-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-fad7105a-e6d9-40fe-af0a-b44240a1bf0a req-04dfbecd-4885-4251-b4c9-ac962ac0a652 tempest-TestShelveInstance-484011381 None] Acquiring lock "cinder-quobyte-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-fad7105a-e6d9-40fe-af0a-b44240a1bf0a req-04dfbecd-4885-4251-b4c9-ac962ac0a652 tempest-TestShelveInstance-484011381 None] Lock "cinder-quobyte-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048" acquired by "delete_volume" :: waited 0.025s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:44 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-7745ba4f-ea41-4241-9af8-041de9bbbdcb tempest-VolumesSnapshotTestJSON-77441170 None] Delete snapshot completed successfully. Sep 16 17:47:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7745ba4f-ea41-4241-9af8-041de9bbbdcb tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-7f76a45b-5cca-4ba9-8017-9b1130694d92-delete_snapshot" released by "delete_snapshot" :: held 2.467s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:44 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[88af6e4a-86f9-4edb-a514-526c408e3002]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-fad7105a-e6d9-40fe-af0a-b44240a1bf0a req-04dfbecd-4885-4251-b4c9-ac962ac0a652 tempest-TestShelveInstance-484011381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:44 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048 Sep 16 17:47:44 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:44 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bcc9f86d-decd-4b65-b8a1-08e257a20c6d tempest-SnapshotsActionsTest-454657474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.9ef44d38-218e-4898-be9e-31aa3ccecf1f" returned: 0 in 0.360s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:44 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-bcc9f86d-decd-4b65-b8a1-08e257a20c6d tempest-SnapshotsActionsTest-454657474 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.9ef44d38-218e-4898-be9e-31aa3ccecf1f is being set with open permissions: ugo+rw Sep 16 17:47:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bcc9f86d-decd-4b65-b8a1-08e257a20c6d tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.9ef44d38-218e-4898-be9e-31aa3ccecf1f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:45 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.9ef44d38-218e-4898-be9e-31aa3ccecf1f Sep 16 17:47:45 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:45 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-fad7105a-e6d9-40fe-af0a-b44240a1bf0a req-04dfbecd-4885-4251-b4c9-ac962ac0a652 tempest-TestShelveInstance-484011381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048" returned: 0 in 0.440s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-fad7105a-e6d9-40fe-af0a-b44240a1bf0a req-04dfbecd-4885-4251-b4c9-ac962ac0a652 tempest-TestShelveInstance-484011381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:45 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048 Sep 16 17:47:45 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:45 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bcc9f86d-decd-4b65-b8a1-08e257a20c6d tempest-SnapshotsActionsTest-454657474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.9ef44d38-218e-4898-be9e-31aa3ccecf1f" returned: 0 in 0.296s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bcc9f86d-decd-4b65-b8a1-08e257a20c6d tempest-SnapshotsActionsTest-454657474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.872s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:45 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-bcc9f86d-decd-4b65-b8a1-08e257a20c6d tempest-SnapshotsActionsTest-454657474 None] Create snapshot completed successfully Sep 16 17:47:45 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-fad7105a-e6d9-40fe-af0a-b44240a1bf0a req-04dfbecd-4885-4251-b4c9-ac962ac0a652 tempest-TestShelveInstance-484011381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048" returned: 0 in 0.304s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-fad7105a-e6d9-40fe-af0a-b44240a1bf0a req-04dfbecd-4885-4251-b4c9-ac962ac0a652 tempest-TestShelveInstance-484011381 None] Lock "cinder-quobyte-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048" released by "delete_volume" :: held 0.812s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:45 devstack cinder-volume[85899]: DEBUG cinder.quota [req-fad7105a-e6d9-40fe-af0a-b44240a1bf0a req-04dfbecd-4885-4251-b4c9-ac962ac0a652 tempest-TestShelveInstance-484011381 None] Created reservations ['8878dd81-0a88-4c85-8b61-3013d92fef0a', 'f9314f2b-dd80-452b-be4f-e55cc8ed3f90', 'f433bfa1-e511-4a0a-975a-c9c3a53d2fbb', '21354421-c352-4afb-a931-2c9cf440d4af'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:47:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-38f498f7-9d40-4ae4-8b68-f36a7e038382 tempest-SnapshotsActionsTest-463651682 None] Acquiring lock "cinder-9ef44d38-218e-4898-be9e-31aa3ccecf1f-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-38f498f7-9d40-4ae4-8b68-f36a7e038382 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-9ef44d38-218e-4898-be9e-31aa3ccecf1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-38f498f7-9d40-4ae4-8b68-f36a7e038382 tempest-SnapshotsActionsTest-463651682 None] Acquiring lock "cinder-quobyte-9e914f9a-5c66-4ddb-8993-35ab984d190f" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-fad7105a-e6d9-40fe-af0a-b44240a1bf0a req-04dfbecd-4885-4251-b4c9-ac962ac0a652 tempest-TestShelveInstance-484011381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-fad7105a-e6d9-40fe-af0a-b44240a1bf0a req-04dfbecd-4885-4251-b4c9-ac962ac0a652 tempest-TestShelveInstance-484011381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [req-fad7105a-e6d9-40fe-af0a-b44240a1bf0a req-04dfbecd-4885-4251-b4c9-ac962ac0a652 tempest-TestShelveInstance-484011381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:47:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [req-fad7105a-e6d9-40fe-af0a-b44240a1bf0a req-04dfbecd-4885-4251-b4c9-ac962ac0a652 tempest-TestShelveInstance-484011381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:47:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-fad7105a-e6d9-40fe-af0a-b44240a1bf0a req-04dfbecd-4885-4251-b4c9-ac962ac0a652 tempest-TestShelveInstance-484011381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-fad7105a-e6d9-40fe-af0a-b44240a1bf0a req-04dfbecd-4885-4251-b4c9-ac962ac0a652 tempest-TestShelveInstance-484011381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-38f498f7-9d40-4ae4-8b68-f36a7e038382 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-quobyte-9e914f9a-5c66-4ddb-8993-35ab984d190f" acquired by "delete_snapshot" :: waited 0.037s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-38f498f7-9d40-4ae4-8b68-f36a7e038382 tempest-SnapshotsActionsTest-463651682 None] Acquiring lock "cinder-quobyte-9ef44d38-218e-4898-be9e-31aa3ccecf1f" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:45 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:47:45 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-38f498f7-9d40-4ae4-8b68-f36a7e038382 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-quobyte-9ef44d38-218e-4898-be9e-31aa3ccecf1f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-38f498f7-9d40-4ae4-8b68-f36a7e038382 tempest-SnapshotsActionsTest-463651682 None] Deleting offline snapshot 9ef44d38-218e-4898-be9e-31aa3ccecf1f of volume 9e914f9a-5c66-4ddb-8993-35ab984d190f {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:47:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-38f498f7-9d40-4ae4-8b68-f36a7e038382 tempest-SnapshotsActionsTest-463651682 None] snapshot_file for this snap is: volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.9ef44d38-218e-4898-be9e-31aa3ccecf1f {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:47:45 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daf314d-b5a6-4ebf-9255-6bbe1450d077]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-38f498f7-9d40-4ae4-8b68-f36a7e038382 tempest-SnapshotsActionsTest-463651682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.9ef44d38-218e-4898-be9e-31aa3ccecf1f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:46 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.9ef44d38-218e-4898-be9e-31aa3ccecf1f Sep 16 17:47:46 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:46 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [req-fad7105a-e6d9-40fe-af0a-b44240a1bf0a req-04dfbecd-4885-4251-b4c9-ac962ac0a652 tempest-TestShelveInstance-484011381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.318s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG cinder.manager [req-fad7105a-e6d9-40fe-af0a-b44240a1bf0a req-04dfbecd-4885-4251-b4c9-ac962ac0a652 tempest-TestShelveInstance-484011381 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:47:46 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-fad7105a-e6d9-40fe-af0a-b44240a1bf0a req-04dfbecd-4885-4251-b4c9-ac962ac0a652 tempest-TestShelveInstance-484011381 None] Deleted volume successfully. Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [req-fad7105a-e6d9-40fe-af0a-b44240a1bf0a req-04dfbecd-4885-4251-b4c9-ac962ac0a652 tempest-TestShelveInstance-484011381 None] Lock "cinder-5a4bf357-e9e4-4f5e-a709-c53dcbd1e048-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Flow 'volume_create_manager' (602a6c73-1d7a-4773-acb3-e2dccdc7278a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95456153-20d5-418f-bcc8-b8f39f802aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95456153-20d5-418f-bcc8-b8f39f802aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-502950180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a119df3-9a54-45f3-ba92-38196af9ca31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9edd60c220492a9a4fa67a420c98e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:47:46Z,use_quota=True,user_id='b581d156dc9245a1bf752ff684cc4bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63447d9-2f13-433b-bb84-30b560737301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63447d9-2f13-433b-bb84-30b560737301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3963df-c94a-4115-8876-e10264a29abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3963df-c94a-4115-8876-e10264a29abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a119df3-9a54-45f3-ba92-38196af9ca31', 'volume_name': 'volume-1a119df3-9a54-45f3-ba92-38196af9ca31', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0737c96-5663-4d9d-8291-10ceb9094a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0737c96-5663-4d9d-8291-10ceb9094a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ded845-6ea0-4863-940f-c221b9622157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:46 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Volume 1a119df3-9a54-45f3-ba92-38196af9ca31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a119df3-9a54-45f3-ba92-38196af9ca31', 'volume_size': 1} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-502950180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a119df3-9a54-45f3-ba92-38196af9ca31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9edd60c220492a9a4fa67a420c98e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:47:46Z,use_quota=True,user_id='b581d156dc9245a1bf752ff684cc4bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Creating volume 1a119df3-9a54-45f3-ba92-38196af9ca31 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:47:46 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:46 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-38f498f7-9d40-4ae4-8b68-f36a7e038382 tempest-SnapshotsActionsTest-463651682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.9ef44d38-218e-4898-be9e-31aa3ccecf1f" returned: 0 in 0.511s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-38f498f7-9d40-4ae4-8b68-f36a7e038382 tempest-SnapshotsActionsTest-463651682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e914f9a-5c66-4ddb-8993-35ab984d190f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:47:46 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31 1073741824 Sep 16 17:47:46 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe08b9c6-61ad-4b84-b47a-2bdefa35909c]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-38f498f7-9d40-4ae4-8b68-f36a7e038382 tempest-SnapshotsActionsTest-463651682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:46 devstack sudo[98506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 Sep 16 17:47:46 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:46 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31 1073741824" returned: 0 in 0.494s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:46 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-38f498f7-9d40-4ae4-8b68-f36a7e038382 tempest-SnapshotsActionsTest-463651682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75" returned: 0 in 0.463s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-38f498f7-9d40-4ae4-8b68-f36a7e038382 tempest-SnapshotsActionsTest-463651682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e914f9a-5c66-4ddb-8993-35ab984d190f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-38f498f7-9d40-4ae4-8b68-f36a7e038382 tempest-SnapshotsActionsTest-463651682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.9ef44d38-218e-4898-be9e-31aa3ccecf1f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:46 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.9ef44d38-218e-4898-be9e-31aa3ccecf1f Sep 16 17:47:46 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:46 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31 Sep 16 17:47:46 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:47 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31" returned: 0 in 0.291s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:47:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ded845-6ea0-4863-940f-c221b9622157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a119df3-9a54-45f3-ba92-38196af9ca31', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf94ccd8-0b02-46ce-aac7-e5b3f56976ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:47 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Volume volume-1a119df3-9a54-45f3-ba92-38196af9ca31 (1a119df3-9a54-45f3-ba92-38196af9ca31): created successfully Sep 16 17:47:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf94ccd8-0b02-46ce-aac7-e5b3f56976ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Flow 'volume_create_manager' (602a6c73-1d7a-4773-acb3-e2dccdc7278a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:47:47 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-19f90c8d-59d7-4c3f-8fa4-302a997c96d6 tempest-VolumesSnapshotTestJSON-77441170 None] Created volume successfully. Sep 16 17:47:47 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-38f498f7-9d40-4ae4-8b68-f36a7e038382 tempest-SnapshotsActionsTest-463651682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.9ef44d38-218e-4898-be9e-31aa3ccecf1f" returned: 0 in 0.414s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-38f498f7-9d40-4ae4-8b68-f36a7e038382 tempest-SnapshotsActionsTest-463651682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.9ef44d38-218e-4898-be9e-31aa3ccecf1f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:47 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.9ef44d38-218e-4898-be9e-31aa3ccecf1f Sep 16 17:47:47 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:47 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-38f498f7-9d40-4ae4-8b68-f36a7e038382 tempest-SnapshotsActionsTest-463651682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.9ef44d38-218e-4898-be9e-31aa3ccecf1f" returned: 0 in 0.262s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:47 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-38f498f7-9d40-4ae4-8b68-f36a7e038382 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-quobyte-9ef44d38-218e-4898-be9e-31aa3ccecf1f" released by "_delete_snapshot" :: held 1.811s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:47 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-38f498f7-9d40-4ae4-8b68-f36a7e038382 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-quobyte-9e914f9a-5c66-4ddb-8993-35ab984d190f" released by "delete_snapshot" :: held 1.840s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:47 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-38f498f7-9d40-4ae4-8b68-f36a7e038382 tempest-SnapshotsActionsTest-463651682 None] Created reservations ['07477db0-f2d2-4390-b1d6-62074ad28cc6', '3b55b6fe-384a-47c4-9377-b5e872aba1b6', '6caf85b9-8bdf-4471-b0db-70c5e9fc02b1', '7f31f24e-8817-40e2-bd4e-d908318c2d8a'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:47:47 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-38f498f7-9d40-4ae4-8b68-f36a7e038382 tempest-SnapshotsActionsTest-463651682 None] Delete snapshot completed successfully. Sep 16 17:47:47 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-38f498f7-9d40-4ae4-8b68-f36a7e038382 tempest-SnapshotsActionsTest-463651682 None] Lock "cinder-9ef44d38-218e-4898-be9e-31aa3ccecf1f-delete_snapshot" released by "delete_snapshot" :: held 2.031s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5617b77c-6475-4666-898c-3a5ee0b3bed8 tempest-SnapshotsActionsTest-454657474 None] Acquiring lock "cinder-c4d7ec10-d3e7-4508-8c50-39c5a3792e75-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5617b77c-6475-4666-898c-3a5ee0b3bed8 tempest-SnapshotsActionsTest-454657474 None] Lock "cinder-c4d7ec10-d3e7-4508-8c50-39c5a3792e75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5617b77c-6475-4666-898c-3a5ee0b3bed8 tempest-SnapshotsActionsTest-454657474 None] Acquiring lock "cinder-quobyte-9e914f9a-5c66-4ddb-8993-35ab984d190f" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5617b77c-6475-4666-898c-3a5ee0b3bed8 tempest-SnapshotsActionsTest-454657474 None] Lock "cinder-quobyte-9e914f9a-5c66-4ddb-8993-35ab984d190f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5617b77c-6475-4666-898c-3a5ee0b3bed8 tempest-SnapshotsActionsTest-454657474 None] Acquiring lock "cinder-quobyte-c4d7ec10-d3e7-4508-8c50-39c5a3792e75" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5617b77c-6475-4666-898c-3a5ee0b3bed8 tempest-SnapshotsActionsTest-454657474 None] Lock "cinder-quobyte-c4d7ec10-d3e7-4508-8c50-39c5a3792e75" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5617b77c-6475-4666-898c-3a5ee0b3bed8 tempest-SnapshotsActionsTest-454657474 None] Deleting offline snapshot c4d7ec10-d3e7-4508-8c50-39c5a3792e75 of volume 9e914f9a-5c66-4ddb-8993-35ab984d190f {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:47:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5617b77c-6475-4666-898c-3a5ee0b3bed8 tempest-SnapshotsActionsTest-454657474 None] snapshot_file for this snap is: volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:47:48 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af7da6e-d4f2-44f3-acfb-824dd870a950]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5617b77c-6475-4666-898c-3a5ee0b3bed8 tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-17809432-bc50-401c-a639-134a6ae24e7e tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-17809432-bc50-401c-a639-134a6ae24e7e tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-17809432-bc50-401c-a639-134a6ae24e7e tempest-VolumesSnapshotTestJSON-77441170 None] Creating offline snapshot 31ff9710-c331-4fab-82d7-0bf3641dfad4 of volume 1a119df3-9a54-45f3-ba92-38196af9ca31 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:47:48 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[17357e7b-0c49-4a1e-8f95-a9aa759b14b0]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-17809432-bc50-401c-a639-134a6ae24e7e tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:48 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 Sep 16 17:47:48 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:48 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31 Sep 16 17:47:48 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:48 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5617b77c-6475-4666-898c-3a5ee0b3bed8 tempest-SnapshotsActionsTest-454657474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75" returned: 0 in 0.437s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5617b77c-6475-4666-898c-3a5ee0b3bed8 tempest-SnapshotsActionsTest-454657474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e914f9a-5c66-4ddb-8993-35ab984d190f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:47:48 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1613cb-9ef9-4d1e-a6ee-16d1cf96b18a]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5617b77c-6475-4666-898c-3a5ee0b3bed8 tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:49 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-17809432-bc50-401c-a639-134a6ae24e7e tempest-VolumesSnapshotTestJSON-77441170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31" returned: 0 in 0.417s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-17809432-bc50-401c-a639-134a6ae24e7e tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.31ff9710-c331-4fab-82d7-0bf3641dfad4 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:49 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f Sep 16 17:47:49 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:49 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.31ff9710-c331-4fab-82d7-0bf3641dfad4 1G Sep 16 17:47:49 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:49 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5617b77c-6475-4666-898c-3a5ee0b3bed8 tempest-SnapshotsActionsTest-454657474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f" returned: 0 in 0.385s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5617b77c-6475-4666-898c-3a5ee0b3bed8 tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:49 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 Sep 16 17:47:49 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:49 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-17809432-bc50-401c-a639-134a6ae24e7e tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.31ff9710-c331-4fab-82d7-0bf3641dfad4 1G" returned: 0 in 0.452s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-17809432-bc50-401c-a639-134a6ae24e7e tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a119df3-9a54-45f3-ba92-38196af9ca31 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.31ff9710-c331-4fab-82d7-0bf3641dfad4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:49 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a119df3-9a54-45f3-ba92-38196af9ca31 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.31ff9710-c331-4fab-82d7-0bf3641dfad4 Sep 16 17:47:49 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:49 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5617b77c-6475-4666-898c-3a5ee0b3bed8 tempest-SnapshotsActionsTest-454657474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75" returned: 0 in 0.477s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5617b77c-6475-4666-898c-3a5ee0b3bed8 tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:49 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75 Sep 16 17:47:49 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:49 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-17809432-bc50-401c-a639-134a6ae24e7e tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a119df3-9a54-45f3-ba92-38196af9ca31 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.31ff9710-c331-4fab-82d7-0bf3641dfad4" returned: 0 in 0.421s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:49 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-17809432-bc50-401c-a639-134a6ae24e7e tempest-VolumesSnapshotTestJSON-77441170 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.31ff9710-c331-4fab-82d7-0bf3641dfad4 is being set with open permissions: ugo+rw Sep 16 17:47:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-17809432-bc50-401c-a639-134a6ae24e7e tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.31ff9710-c331-4fab-82d7-0bf3641dfad4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:49 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.31ff9710-c331-4fab-82d7-0bf3641dfad4 Sep 16 17:47:49 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:50 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5617b77c-6475-4666-898c-3a5ee0b3bed8 tempest-SnapshotsActionsTest-454657474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f.c4d7ec10-d3e7-4508-8c50-39c5a3792e75" returned: 0 in 0.296s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5617b77c-6475-4666-898c-3a5ee0b3bed8 tempest-SnapshotsActionsTest-454657474 None] Lock "cinder-quobyte-c4d7ec10-d3e7-4508-8c50-39c5a3792e75" released by "_delete_snapshot" :: held 1.733s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5617b77c-6475-4666-898c-3a5ee0b3bed8 tempest-SnapshotsActionsTest-454657474 None] Lock "cinder-quobyte-9e914f9a-5c66-4ddb-8993-35ab984d190f" released by "delete_snapshot" :: held 1.763s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:50 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-17809432-bc50-401c-a639-134a6ae24e7e tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.31ff9710-c331-4fab-82d7-0bf3641dfad4" returned: 0 in 0.284s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:50 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-5617b77c-6475-4666-898c-3a5ee0b3bed8 tempest-SnapshotsActionsTest-454657474 None] Created reservations ['717818b6-b515-4689-8c14-ada95cb5d579', 'cee9210a-c563-45cf-8aeb-a53e78456616', 'def5d226-0357-4fdd-8e60-c0c2cebbf1c2', '29808459-0b54-4604-96f9-b8fe7118a2bc'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:47:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-17809432-bc50-401c-a639-134a6ae24e7e tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:50 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.info Sep 16 17:47:50 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:50 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5617b77c-6475-4666-898c-3a5ee0b3bed8 tempest-SnapshotsActionsTest-454657474 None] Delete snapshot completed successfully. Sep 16 17:47:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5617b77c-6475-4666-898c-3a5ee0b3bed8 tempest-SnapshotsActionsTest-454657474 None] Lock "cinder-c4d7ec10-d3e7-4508-8c50-39c5a3792e75-delete_snapshot" released by "delete_snapshot" :: held 1.967s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:50 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-17809432-bc50-401c-a639-134a6ae24e7e tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.info" returned: 0 in 0.314s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:50 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-17809432-bc50-401c-a639-134a6ae24e7e tempest-VolumesSnapshotTestJSON-77441170 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.info is being set with open permissions: ugo+rw Sep 16 17:47:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-17809432-bc50-401c-a639-134a6ae24e7e tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:50 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.info Sep 16 17:47:50 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9bb680f1-8690-4e33-922a-812062a242ea tempest-SnapshotsActionsTest-454657474 None] Acquiring lock "cinder-9e914f9a-5c66-4ddb-8993-35ab984d190f-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9bb680f1-8690-4e33-922a-812062a242ea tempest-SnapshotsActionsTest-454657474 None] Lock "cinder-9e914f9a-5c66-4ddb-8993-35ab984d190f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9bb680f1-8690-4e33-922a-812062a242ea tempest-SnapshotsActionsTest-454657474 None] Acquiring lock "cinder-quobyte-9e914f9a-5c66-4ddb-8993-35ab984d190f" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9bb680f1-8690-4e33-922a-812062a242ea tempest-SnapshotsActionsTest-454657474 None] Lock "cinder-quobyte-9e914f9a-5c66-4ddb-8993-35ab984d190f" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:50 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b937903-7b50-4939-8ccc-4daaf5b046cf]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9bb680f1-8690-4e33-922a-812062a242ea tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:50 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-17809432-bc50-401c-a639-134a6ae24e7e tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.info" returned: 0 in 0.355s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:50 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f Sep 16 17:47:50 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-17809432-bc50-401c-a639-134a6ae24e7e tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.381s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:50 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-17809432-bc50-401c-a639-134a6ae24e7e tempest-VolumesSnapshotTestJSON-77441170 None] Create snapshot completed successfully Sep 16 17:47:51 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9bb680f1-8690-4e33-922a-812062a242ea tempest-SnapshotsActionsTest-454657474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f" returned: 0 in 0.432s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9bb680f1-8690-4e33-922a-812062a242ea tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:51 devstack sudo[98579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f Sep 16 17:47:51 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:51 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9bb680f1-8690-4e33-922a-812062a242ea tempest-SnapshotsActionsTest-454657474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9e914f9a-5c66-4ddb-8993-35ab984d190f" returned: 0 in 0.263s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9bb680f1-8690-4e33-922a-812062a242ea tempest-SnapshotsActionsTest-454657474 None] Lock "cinder-quobyte-9e914f9a-5c66-4ddb-8993-35ab984d190f" released by "delete_volume" :: held 0.788s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:51 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-9bb680f1-8690-4e33-922a-812062a242ea tempest-SnapshotsActionsTest-454657474 None] Created reservations ['ddf32e8b-1a34-4496-9623-f65dd6798dd1', 'aa4bb65c-1547-4385-8670-9407a40578a8', '985b1a3e-f883-4cf9-a80d-9b5f69560457', '04137249-de9d-4c02-85eb-43cb25b50a47'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:47:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9bb680f1-8690-4e33-922a-812062a242ea tempest-SnapshotsActionsTest-454657474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9bb680f1-8690-4e33-922a-812062a242ea tempest-SnapshotsActionsTest-454657474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9bb680f1-8690-4e33-922a-812062a242ea tempest-SnapshotsActionsTest-454657474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:47:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9bb680f1-8690-4e33-922a-812062a242ea tempest-SnapshotsActionsTest-454657474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:47:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9bb680f1-8690-4e33-922a-812062a242ea tempest-SnapshotsActionsTest-454657474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9bb680f1-8690-4e33-922a-812062a242ea tempest-SnapshotsActionsTest-454657474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:51 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:47:51 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:51 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9bb680f1-8690-4e33-922a-812062a242ea tempest-SnapshotsActionsTest-454657474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.283s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:51 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-9bb680f1-8690-4e33-922a-812062a242ea tempest-SnapshotsActionsTest-454657474 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:47:51 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-9bb680f1-8690-4e33-922a-812062a242ea tempest-SnapshotsActionsTest-454657474 None] Deleted volume successfully. Sep 16 17:47:51 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=108,cinder:INSERT=30,cinder:UPDATE=114,cinder:DELETE=9 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:47:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9bb680f1-8690-4e33-922a-812062a242ea tempest-SnapshotsActionsTest-454657474 None] Lock "cinder-9e914f9a-5c66-4ddb-8993-35ab984d190f-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=110,cinder:INSERT=29,cinder:UPDATE=109,cinder:DELETE=10 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Flow 'volume_create_manager' (94be208a-c23d-4e19-a49b-e6876a5caf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00ff604-327f-4c2f-9e75-bcb23b512ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00ff604-327f-4c2f-9e75-bcb23b512ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-560465911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f63e5739-4bf3-4540-ba33-4c113e14003a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9edd60c220492a9a4fa67a420c98e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:47:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=31ff9710-c331-4fab-82d7-0bf3641dfad4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:47:52Z,use_quota=True,user_id='b581d156dc9245a1bf752ff684cc4bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9930e290-8944-43a4-829d-a262a6b141e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9930e290-8944-43a4-829d-a262a6b141e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e874c09a-f9e2-4f18-8c7d-d35e9ba93b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e874c09a-f9e2-4f18-8c7d-d35e9ba93b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f63e5739-4bf3-4540-ba33-4c113e14003a', 'volume_name': 'volume-f63e5739-4bf3-4540-ba33-4c113e14003a', 'volume_size': 2, 'snapshot_id': '31ff9710-c331-4fab-82d7-0bf3641dfad4'}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9cbe411-5115-46b2-92ef-4b2c3492a451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9cbe411-5115-46b2-92ef-4b2c3492a451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb8d6fb-1953-4efe-901c-cf0c24215222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:47:52 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Volume f63e5739-4bf3-4540-ba33-4c113e14003a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f63e5739-4bf3-4540-ba33-4c113e14003a', 'volume_size': 2, 'snapshot_id': '31ff9710-c331-4fab-82d7-0bf3641dfad4'} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "cinder-quobyte-31ff9710-c331-4fab-82d7-0bf3641dfad4-f63e5739-4bf3-4540-ba33-4c113e14003a" by "_create_volume_from_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-31ff9710-c331-4fab-82d7-0bf3641dfad4-f63e5739-4bf3-4540-ba33-4c113e14003a" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Creating volume f63e5739-4bf3-4540-ba33-4c113e14003a from snapshot 31ff9710-c331-4fab-82d7-0bf3641dfad4 {{(pid=85899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "cinder-quobyte-f63e5739-4bf3-4540-ba33-4c113e14003a" by "_copy_volume_from_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-f63e5739-4bf3-4540-ba33-4c113e14003a" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] snapshot: 31ff9710-c331-4fab-82d7-0bf3641dfad4, volume: f63e5739-4bf3-4540-ba33-4c113e14003a, {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d20c0b-154e-4c7c-9351-4d184e058627]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.31ff9710-c331-4fab-82d7-0bf3641dfad4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:52 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.31ff9710-c331-4fab-82d7-0bf3641dfad4 Sep 16 17:47:52 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:52 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.31ff9710-c331-4fab-82d7-0bf3641dfad4" returned: 0 in 0.441s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a119df3-9a54-45f3-ba92-38196af9ca31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:47:53 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[160a4c21-0116-423c-91ce-c8c3c848cd06]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:47:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:53 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31 Sep 16 17:47:53 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:47:53 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Sep 16 17:47:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31" returned: 0 in 0.461s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:47:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31 {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 17:47:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Creating direct copy from snapshot {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 17:47:53 devstack cinder-volume[85899]: DEBUG cinder.utils [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Path /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f63e5739-4bf3-4540-ba33-4c113e14003a not found in is_blk_device check {{(pid=85899) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 17:47:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f63e5739-4bf3-4540-ba33-4c113e14003a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:47:53 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f63e5739-4bf3-4540-ba33-4c113e14003a Sep 16 17:47:53 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:01 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f63e5739-4bf3-4540-ba33-4c113e14003a" returned: 0 in 8.444s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:01 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Image conversion details: src /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31, size 1024.00 MB, duration 8.45 sec, destination /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f63e5739-4bf3-4540-ba33-4c113e14003a {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:48:01 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Converted 1024.00 MB image at 121.24 MB/s Sep 16 17:48:01 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f63e5739-4bf3-4540-ba33-4c113e14003a is being set with open permissions: ugo+rw Sep 16 17:48:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f63e5739-4bf3-4540-ba33-4c113e14003a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:01 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f63e5739-4bf3-4540-ba33-4c113e14003a Sep 16 17:48:01 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:48:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:48:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:48:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:48:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:48:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:48:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:02 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f63e5739-4bf3-4540-ba33-4c113e14003a" returned: 0 in 0.285s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-f63e5739-4bf3-4540-ba33-4c113e14003a" released by "_copy_volume_from_snapshot" :: held 9.743s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:48:02 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:48:02 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-31ff9710-c331-4fab-82d7-0bf3641dfad4-f63e5739-4bf3-4540-ba33-4c113e14003a" released by "_create_volume_from_snapshot" :: held 9.875s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:48:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.890s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:48:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb8d6fb-1953-4efe-901c-cf0c24215222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f63e5739-4bf3-4540-ba33-4c113e14003a', 'volume_size': 2, 'snapshot_id': '31ff9710-c331-4fab-82d7-0bf3641dfad4'}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:48:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa1b87e-1e07-4c21-ab20-54ce123b2fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:48:02 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Volume volume-f63e5739-4bf3-4540-ba33-4c113e14003a (f63e5739-4bf3-4540-ba33-4c113e14003a): created successfully Sep 16 17:48:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa1b87e-1e07-4c21-ab20-54ce123b2fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:48:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Flow 'volume_create_manager' (94be208a-c23d-4e19-a49b-e6876a5caf39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:48:02 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5eaa1bf3-ab07-4aed-bffb-fa2aa2651b4d tempest-VolumesSnapshotTestJSON-77441170 None] Created volume successfully. Sep 16 17:48:02 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.294s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:48:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager._thread_info {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:48:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread count: 28 {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:48:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread info: [<_MainThread(MainThread, started 123748124422272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:48:03 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-745f5c67-7b7e-40a0-99e7-0357b2e96b20 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "cinder-f63e5739-4bf3-4540-ba33-4c113e14003a-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:48:03 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-745f5c67-7b7e-40a0-99e7-0357b2e96b20 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-f63e5739-4bf3-4540-ba33-4c113e14003a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:48:03 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-745f5c67-7b7e-40a0-99e7-0357b2e96b20 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "cinder-quobyte-f63e5739-4bf3-4540-ba33-4c113e14003a" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:48:03 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-745f5c67-7b7e-40a0-99e7-0357b2e96b20 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-f63e5739-4bf3-4540-ba33-4c113e14003a" acquired by "delete_volume" :: waited 0.026s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:48:03 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabc7780-49e2-44fe-ba05-28db09be117a]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:48:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-745f5c67-7b7e-40a0-99e7-0357b2e96b20 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f63e5739-4bf3-4540-ba33-4c113e14003a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:03 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f63e5739-4bf3-4540-ba33-4c113e14003a Sep 16 17:48:03 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:04 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-745f5c67-7b7e-40a0-99e7-0357b2e96b20 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f63e5739-4bf3-4540-ba33-4c113e14003a" returned: 0 in 0.472s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-745f5c67-7b7e-40a0-99e7-0357b2e96b20 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f63e5739-4bf3-4540-ba33-4c113e14003a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:04 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f63e5739-4bf3-4540-ba33-4c113e14003a Sep 16 17:48:04 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:04 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-745f5c67-7b7e-40a0-99e7-0357b2e96b20 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f63e5739-4bf3-4540-ba33-4c113e14003a" returned: 0 in 0.275s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:04 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-745f5c67-7b7e-40a0-99e7-0357b2e96b20 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-f63e5739-4bf3-4540-ba33-4c113e14003a" released by "delete_volume" :: held 0.803s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:48:04 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-745f5c67-7b7e-40a0-99e7-0357b2e96b20 tempest-VolumesSnapshotTestJSON-77441170 None] Created reservations ['9ebead2b-323b-4d74-89c3-f3828140dfdf', '124a8949-36ae-49e2-9d45-9d4f7a1237c5', '6627e0b8-0ae1-4f5a-a1b1-96422b63542d', '664896c7-d9a4-4827-b5b7-403e4ab663eb'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:48:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-745f5c67-7b7e-40a0-99e7-0357b2e96b20 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:48:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-745f5c67-7b7e-40a0-99e7-0357b2e96b20 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:48:04 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-745f5c67-7b7e-40a0-99e7-0357b2e96b20 tempest-VolumesSnapshotTestJSON-77441170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:48:04 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-745f5c67-7b7e-40a0-99e7-0357b2e96b20 tempest-VolumesSnapshotTestJSON-77441170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:48:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-745f5c67-7b7e-40a0-99e7-0357b2e96b20 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:48:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-745f5c67-7b7e-40a0-99e7-0357b2e96b20 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:04 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:48:04 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:04 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-010b8c6d-7bb1-4a4f-bbf8-032e63143635 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "cinder-31ff9710-c331-4fab-82d7-0bf3641dfad4-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:48:04 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-010b8c6d-7bb1-4a4f-bbf8-032e63143635 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-31ff9710-c331-4fab-82d7-0bf3641dfad4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:48:04 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-010b8c6d-7bb1-4a4f-bbf8-032e63143635 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "cinder-quobyte-1a119df3-9a54-45f3-ba92-38196af9ca31" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:48:04 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-010b8c6d-7bb1-4a4f-bbf8-032e63143635 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-1a119df3-9a54-45f3-ba92-38196af9ca31" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:48:04 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-010b8c6d-7bb1-4a4f-bbf8-032e63143635 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "cinder-quobyte-31ff9710-c331-4fab-82d7-0bf3641dfad4" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:48:04 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-010b8c6d-7bb1-4a4f-bbf8-032e63143635 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-31ff9710-c331-4fab-82d7-0bf3641dfad4" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:48:04 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-010b8c6d-7bb1-4a4f-bbf8-032e63143635 tempest-VolumesSnapshotTestJSON-77441170 None] Deleting offline snapshot 31ff9710-c331-4fab-82d7-0bf3641dfad4 of volume 1a119df3-9a54-45f3-ba92-38196af9ca31 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:48:04 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:04 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-010b8c6d-7bb1-4a4f-bbf8-032e63143635 tempest-VolumesSnapshotTestJSON-77441170 None] snapshot_file for this snap is: volume-1a119df3-9a54-45f3-ba92-38196af9ca31.31ff9710-c331-4fab-82d7-0bf3641dfad4 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:48:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-745f5c67-7b7e-40a0-99e7-0357b2e96b20 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.336s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:04 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-745f5c67-7b7e-40a0-99e7-0357b2e96b20 tempest-VolumesSnapshotTestJSON-77441170 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:48:04 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-745f5c67-7b7e-40a0-99e7-0357b2e96b20 tempest-VolumesSnapshotTestJSON-77441170 None] Deleted volume successfully. Sep 16 17:48:04 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5644ac5-b13d-4b26-9691-dd707cef0152]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:48:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-010b8c6d-7bb1-4a4f-bbf8-032e63143635 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.31ff9710-c331-4fab-82d7-0bf3641dfad4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:05 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-745f5c67-7b7e-40a0-99e7-0357b2e96b20 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-f63e5739-4bf3-4540-ba33-4c113e14003a-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:48:05 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.31ff9710-c331-4fab-82d7-0bf3641dfad4 Sep 16 17:48:05 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:05 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-010b8c6d-7bb1-4a4f-bbf8-032e63143635 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.31ff9710-c331-4fab-82d7-0bf3641dfad4" returned: 0 in 0.475s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:05 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-010b8c6d-7bb1-4a4f-bbf8-032e63143635 tempest-VolumesSnapshotTestJSON-77441170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a119df3-9a54-45f3-ba92-38196af9ca31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:48:05 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8613b874-5da9-4c75-9e3f-17e5045046c0]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:48:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-010b8c6d-7bb1-4a4f-bbf8-032e63143635 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:05 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31 Sep 16 17:48:05 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:06 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-010b8c6d-7bb1-4a4f-bbf8-032e63143635 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31" returned: 0 in 0.631s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-010b8c6d-7bb1-4a4f-bbf8-032e63143635 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.31ff9710-c331-4fab-82d7-0bf3641dfad4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:06 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.31ff9710-c331-4fab-82d7-0bf3641dfad4 Sep 16 17:48:06 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:06 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-010b8c6d-7bb1-4a4f-bbf8-032e63143635 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.31ff9710-c331-4fab-82d7-0bf3641dfad4" returned: 0 in 0.391s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-010b8c6d-7bb1-4a4f-bbf8-032e63143635 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.31ff9710-c331-4fab-82d7-0bf3641dfad4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:06 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.31ff9710-c331-4fab-82d7-0bf3641dfad4 Sep 16 17:48:06 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:06 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-010b8c6d-7bb1-4a4f-bbf8-032e63143635 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31.31ff9710-c331-4fab-82d7-0bf3641dfad4" returned: 0 in 0.263s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:06 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-010b8c6d-7bb1-4a4f-bbf8-032e63143635 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-31ff9710-c331-4fab-82d7-0bf3641dfad4" released by "_delete_snapshot" :: held 1.933s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:48:06 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-010b8c6d-7bb1-4a4f-bbf8-032e63143635 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-1a119df3-9a54-45f3-ba92-38196af9ca31" released by "delete_snapshot" :: held 1.967s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:48:06 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-010b8c6d-7bb1-4a4f-bbf8-032e63143635 tempest-VolumesSnapshotTestJSON-77441170 None] Created reservations ['6f5f8c74-b1d5-430c-9933-c80c773f3e3a', '13e5501f-8afe-4459-9a40-6b22fe66c478', 'e9547cd0-6739-4138-962e-1f43a65a7878', '2750131c-97ba-4230-9728-f8d42f0f15ff'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:48:07 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-010b8c6d-7bb1-4a4f-bbf8-032e63143635 tempest-VolumesSnapshotTestJSON-77441170 None] Delete snapshot completed successfully. Sep 16 17:48:07 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-010b8c6d-7bb1-4a4f-bbf8-032e63143635 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-31ff9710-c331-4fab-82d7-0bf3641dfad4-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:48:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a39dd049-75a3-4ac3-9f0a-633b81047614 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "cinder-1a119df3-9a54-45f3-ba92-38196af9ca31-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:48:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a39dd049-75a3-4ac3-9f0a-633b81047614 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-1a119df3-9a54-45f3-ba92-38196af9ca31-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:48:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a39dd049-75a3-4ac3-9f0a-633b81047614 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "cinder-quobyte-1a119df3-9a54-45f3-ba92-38196af9ca31" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:48:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a39dd049-75a3-4ac3-9f0a-633b81047614 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-1a119df3-9a54-45f3-ba92-38196af9ca31" acquired by "delete_volume" :: waited 0.027s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:48:08 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed7289a-9dc0-4dd0-9377-6e0b0545ab65]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:48:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a39dd049-75a3-4ac3-9f0a-633b81047614 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:08 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31 Sep 16 17:48:08 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:08 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a39dd049-75a3-4ac3-9f0a-633b81047614 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31" returned: 0 in 0.477s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a39dd049-75a3-4ac3-9f0a-633b81047614 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:09 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31 Sep 16 17:48:09 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:09 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a39dd049-75a3-4ac3-9f0a-633b81047614 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1a119df3-9a54-45f3-ba92-38196af9ca31" returned: 0 in 0.360s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:09 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a39dd049-75a3-4ac3-9f0a-633b81047614 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-1a119df3-9a54-45f3-ba92-38196af9ca31" released by "delete_volume" :: held 0.927s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:48:09 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-a39dd049-75a3-4ac3-9f0a-633b81047614 tempest-VolumesSnapshotTestJSON-77441170 None] Created reservations ['2e45cd3c-a2dd-4b6d-af00-1457482354ed', 'cfb90cac-c8bd-42ac-aa78-ea33c8dec69c', '45ee9b32-b65e-4c78-a0ca-8d13995bafb6', 'ff3779a8-d0f8-4576-916b-b1b95d701f43'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:48:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a39dd049-75a3-4ac3-9f0a-633b81047614 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:48:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a39dd049-75a3-4ac3-9f0a-633b81047614 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:48:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a39dd049-75a3-4ac3-9f0a-633b81047614 tempest-VolumesSnapshotTestJSON-77441170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:48:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a39dd049-75a3-4ac3-9f0a-633b81047614 tempest-VolumesSnapshotTestJSON-77441170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:48:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a39dd049-75a3-4ac3-9f0a-633b81047614 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:48:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a39dd049-75a3-4ac3-9f0a-633b81047614 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:09 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:48:09 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:09 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a39dd049-75a3-4ac3-9f0a-633b81047614 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.323s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:09 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-a39dd049-75a3-4ac3-9f0a-633b81047614 tempest-VolumesSnapshotTestJSON-77441170 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:48:09 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-a39dd049-75a3-4ac3-9f0a-633b81047614 tempest-VolumesSnapshotTestJSON-77441170 None] Deleted volume successfully. Sep 16 17:48:09 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a39dd049-75a3-4ac3-9f0a-633b81047614 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-1a119df3-9a54-45f3-ba92-38196af9ca31-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Flow 'volume_create_manager' (f1fb09a0-d150-4053-9fa9-5cb3071a812d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd819280-9071-4dac-bd2c-a45bfafee17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd819280-9071-4dac-bd2c-a45bfafee17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1206434920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a70af72-f4c4-4f8c-8091-a2bb523c947f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9edd60c220492a9a4fa67a420c98e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:48:11Z,use_quota=True,user_id='b581d156dc9245a1bf752ff684cc4bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d2ca43-cd24-4060-abbb-0916dff3c43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d2ca43-cd24-4060-abbb-0916dff3c43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16064384-e7ab-4911-91a6-37cb643403f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16064384-e7ab-4911-91a6-37cb643403f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a70af72-f4c4-4f8c-8091-a2bb523c947f', 'volume_name': 'volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f05e13-c766-4056-a0dd-c7ffc14ed4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f05e13-c766-4056-a0dd-c7ffc14ed4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b485ae-8437-426b-9d67-c41bf8a73ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:48:11 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Volume 5a70af72-f4c4-4f8c-8091-a2bb523c947f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f', 'volume_size': 1} Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1206434920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a70af72-f4c4-4f8c-8091-a2bb523c947f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9edd60c220492a9a4fa67a420c98e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:48:11Z,use_quota=True,user_id='b581d156dc9245a1bf752ff684cc4bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Creating volume 5a70af72-f4c4-4f8c-8091-a2bb523c947f {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:48:11 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:11 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f 1073741824 Sep 16 17:48:11 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:11 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f 1073741824" returned: 0 in 0.567s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:12 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f Sep 16 17:48:12 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:12 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f" returned: 0 in 0.318s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:12 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:48:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:48:12 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b485ae-8437-426b-9d67-c41bf8a73ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:48:12 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049d01b4-9e9d-4821-892d-8f468c7ebbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:48:12 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Volume volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f (5a70af72-f4c4-4f8c-8091-a2bb523c947f): created successfully Sep 16 17:48:12 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049d01b4-9e9d-4821-892d-8f468c7ebbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:48:12 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Flow 'volume_create_manager' (f1fb09a0-d150-4053-9fa9-5cb3071a812d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:48:12 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-fc81e113-3fc9-42c0-af81-8798624ce145 tempest-VolumesSnapshotTestJSON-77441170 None] Created volume successfully. Sep 16 17:48:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1a848d11-ac5c-4452-a1c9-590589b84415 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:48:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1a848d11-ac5c-4452-a1c9-590589b84415 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:48:13 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-1a848d11-ac5c-4452-a1c9-590589b84415 tempest-VolumesSnapshotTestJSON-77441170 None] Creating offline snapshot 0d5b50df-2568-4259-b39b-457cd095c3e9 of volume 5a70af72-f4c4-4f8c-8091-a2bb523c947f {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:48:13 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[be42f2aa-e244-4800-8fd9-76ff37726112]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:48:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1a848d11-ac5c-4452-a1c9-590589b84415 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:13 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f Sep 16 17:48:13 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:14 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1a848d11-ac5c-4452-a1c9-590589b84415 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f" returned: 0 in 0.448s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1a848d11-ac5c-4452-a1c9-590589b84415 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.0d5b50df-2568-4259-b39b-457cd095c3e9 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:14 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.0d5b50df-2568-4259-b39b-457cd095c3e9 1G Sep 16 17:48:14 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:14 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1a848d11-ac5c-4452-a1c9-590589b84415 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.0d5b50df-2568-4259-b39b-457cd095c3e9 1G" returned: 0 in 0.533s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1a848d11-ac5c-4452-a1c9-590589b84415 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.0d5b50df-2568-4259-b39b-457cd095c3e9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:14 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.0d5b50df-2568-4259-b39b-457cd095c3e9 Sep 16 17:48:14 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:15 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1a848d11-ac5c-4452-a1c9-590589b84415 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.0d5b50df-2568-4259-b39b-457cd095c3e9" returned: 0 in 0.369s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:15 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-1a848d11-ac5c-4452-a1c9-590589b84415 tempest-VolumesSnapshotTestJSON-77441170 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.0d5b50df-2568-4259-b39b-457cd095c3e9 is being set with open permissions: ugo+rw Sep 16 17:48:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1a848d11-ac5c-4452-a1c9-590589b84415 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.0d5b50df-2568-4259-b39b-457cd095c3e9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:15 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.0d5b50df-2568-4259-b39b-457cd095c3e9 Sep 16 17:48:15 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:15 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1a848d11-ac5c-4452-a1c9-590589b84415 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.0d5b50df-2568-4259-b39b-457cd095c3e9" returned: 0 in 0.286s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1a848d11-ac5c-4452-a1c9-590589b84415 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:15 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.info Sep 16 17:48:15 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:15 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1a848d11-ac5c-4452-a1c9-590589b84415 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.info" returned: 0 in 0.284s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:15 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-1a848d11-ac5c-4452-a1c9-590589b84415 tempest-VolumesSnapshotTestJSON-77441170 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.info is being set with open permissions: ugo+rw Sep 16 17:48:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1a848d11-ac5c-4452-a1c9-590589b84415 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:15 devstack sudo[98694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.info Sep 16 17:48:15 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:15 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1a848d11-ac5c-4452-a1c9-590589b84415 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.info" returned: 0 in 0.247s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1a848d11-ac5c-4452-a1c9-590589b84415 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.291s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:48:15 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-1a848d11-ac5c-4452-a1c9-590589b84415 tempest-VolumesSnapshotTestJSON-77441170 None] Create snapshot completed successfully Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Flow 'volume_create_manager' (eca9601e-cd6a-4cf0-90c7-cf4da44be9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819b8824-0099-453c-a471-85da529af20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819b8824-0099-453c-a471-85da529af20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1695016213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f5d8e2-b81c-4931-89ed-1c910eaf7219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9edd60c220492a9a4fa67a420c98e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0d5b50df-2568-4259-b39b-457cd095c3e9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:48:17Z,use_quota=True,user_id='b581d156dc9245a1bf752ff684cc4bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beda5c05-3611-4a7c-97b5-6d1b30d3c907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beda5c05-3611-4a7c-97b5-6d1b30d3c907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083cdc05-78f9-4a77-ae6e-7768f2feb49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083cdc05-78f9-4a77-ae6e-7768f2feb49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '32f5d8e2-b81c-4931-89ed-1c910eaf7219', 'volume_name': 'volume-32f5d8e2-b81c-4931-89ed-1c910eaf7219', 'volume_size': 1, 'snapshot_id': '0d5b50df-2568-4259-b39b-457cd095c3e9'}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30120099-55e1-409c-9292-d42877757cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30120099-55e1-409c-9292-d42877757cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71033b2f-57ad-4842-8505-77910689973d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:48:17 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Volume 32f5d8e2-b81c-4931-89ed-1c910eaf7219: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-32f5d8e2-b81c-4931-89ed-1c910eaf7219', 'volume_size': 1, 'snapshot_id': '0d5b50df-2568-4259-b39b-457cd095c3e9'} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "cinder-quobyte-0d5b50df-2568-4259-b39b-457cd095c3e9-32f5d8e2-b81c-4931-89ed-1c910eaf7219" by "_create_volume_from_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-0d5b50df-2568-4259-b39b-457cd095c3e9-32f5d8e2-b81c-4931-89ed-1c910eaf7219" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Creating volume 32f5d8e2-b81c-4931-89ed-1c910eaf7219 from snapshot 0d5b50df-2568-4259-b39b-457cd095c3e9 {{(pid=85899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "cinder-quobyte-32f5d8e2-b81c-4931-89ed-1c910eaf7219" by "_copy_volume_from_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-32f5d8e2-b81c-4931-89ed-1c910eaf7219" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] snapshot: 0d5b50df-2568-4259-b39b-457cd095c3e9, volume: 32f5d8e2-b81c-4931-89ed-1c910eaf7219, {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8daef87f-8a25-469d-9797-ed19132cca96]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:48:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.0d5b50df-2568-4259-b39b-457cd095c3e9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:17 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.0d5b50df-2568-4259-b39b-457cd095c3e9 Sep 16 17:48:17 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:18 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.0d5b50df-2568-4259-b39b-457cd095c3e9" returned: 0 in 0.395s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:48:18 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ca73ff-fd8c-4d4b-a759-cda10d9b4711]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:48:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:18 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f Sep 16 17:48:18 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:18 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f" returned: 0 in 0.405s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 17:48:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Creating direct copy from snapshot {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 17:48:18 devstack cinder-volume[85899]: DEBUG cinder.utils [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Path /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-32f5d8e2-b81c-4931-89ed-1c910eaf7219 not found in is_blk_device check {{(pid=85899) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 17:48:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-32f5d8e2-b81c-4931-89ed-1c910eaf7219 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:18 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-32f5d8e2-b81c-4931-89ed-1c910eaf7219 Sep 16 17:48:18 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:27 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-32f5d8e2-b81c-4931-89ed-1c910eaf7219" returned: 0 in 8.929s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:27 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Image conversion details: src /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f, size 1024.00 MB, duration 8.93 sec, destination /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-32f5d8e2-b81c-4931-89ed-1c910eaf7219 {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:48:27 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Converted 1024.00 MB image at 114.66 MB/s Sep 16 17:48:27 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-32f5d8e2-b81c-4931-89ed-1c910eaf7219 is being set with open permissions: ugo+rw Sep 16 17:48:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-32f5d8e2-b81c-4931-89ed-1c910eaf7219 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:27 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-32f5d8e2-b81c-4931-89ed-1c910eaf7219 Sep 16 17:48:27 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:27 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=20,cinder:INSERT=9,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:48:27 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=33,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=3 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:48:27 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-32f5d8e2-b81c-4931-89ed-1c910eaf7219" returned: 0 in 0.265s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:27 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-32f5d8e2-b81c-4931-89ed-1c910eaf7219" released by "_copy_volume_from_snapshot" :: held 10.108s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:48:27 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-0d5b50df-2568-4259-b39b-457cd095c3e9-32f5d8e2-b81c-4931-89ed-1c910eaf7219" released by "_create_volume_from_snapshot" :: held 10.202s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:48:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.251s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:48:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71033b2f-57ad-4842-8505-77910689973d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32f5d8e2-b81c-4931-89ed-1c910eaf7219', 'volume_size': 1, 'snapshot_id': '0d5b50df-2568-4259-b39b-457cd095c3e9'}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:48:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c7e49b-d506-4353-9fb1-a4350d7110ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:48:27 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Volume volume-32f5d8e2-b81c-4931-89ed-1c910eaf7219 (32f5d8e2-b81c-4931-89ed-1c910eaf7219): created successfully Sep 16 17:48:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c7e49b-d506-4353-9fb1-a4350d7110ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:48:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Flow 'volume_create_manager' (eca9601e-cd6a-4cf0-90c7-cf4da44be9eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:48:27 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-bbe0780b-799b-4fb2-abb2-a52dae5445a1 tempest-VolumesSnapshotTestJSON-77441170 None] Created volume successfully. Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Flow 'volume_create_manager' (4b403b9b-12f2-4782-ac5b-e071ea0bd3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe7b566-e895-45ca-8ac4-4d0da0ef0e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe7b566-e895-45ca-8ac4-4d0da0ef0e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-76157921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60399b15-b099-4a28-b63c-856dd9f232d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e9e9d5810d34180baa739d349868225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:48:28Z,use_quota=True,user_id='a626f2bc9f424184b8d816be1b2ce8a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087efa62-98cc-4ed1-bd2d-8f1ffef2f692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087efa62-98cc-4ed1-bd2d-8f1ffef2f692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2d2df9-c267-432c-9a9a-4fde14f7b4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2d2df9-c267-432c-9a9a-4fde14f7b4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60399b15-b099-4a28-b63c-856dd9f232d6', 'volume_name': 'volume-60399b15-b099-4a28-b63c-856dd9f232d6', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df82f436-10fc-4d67-a1d4-b3bd1d4078c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df82f436-10fc-4d67-a1d4-b3bd1d4078c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a2c7e1-a5c6-407f-ae77-486a64ecd514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:48:28 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Volume 60399b15-b099-4a28-b63c-856dd9f232d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60399b15-b099-4a28-b63c-856dd9f232d6', 'volume_size': 1} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-76157921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60399b15-b099-4a28-b63c-856dd9f232d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e9e9d5810d34180baa739d349868225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:48:28Z,use_quota=True,user_id='a626f2bc9f424184b8d816be1b2ce8a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Creating volume 60399b15-b099-4a28-b63c-856dd9f232d6 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:48:28 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:28 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6 1073741824 Sep 16 17:48:28 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2d1bf406-ff79-4117-95ca-74bf00d299c8 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "cinder-32f5d8e2-b81c-4931-89ed-1c910eaf7219-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2d1bf406-ff79-4117-95ca-74bf00d299c8 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-32f5d8e2-b81c-4931-89ed-1c910eaf7219-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2d1bf406-ff79-4117-95ca-74bf00d299c8 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "cinder-quobyte-32f5d8e2-b81c-4931-89ed-1c910eaf7219" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2d1bf406-ff79-4117-95ca-74bf00d299c8 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-32f5d8e2-b81c-4931-89ed-1c910eaf7219" acquired by "delete_volume" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f07454e-5464-468a-b147-57d74210989a]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:48:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2d1bf406-ff79-4117-95ca-74bf00d299c8 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-32f5d8e2-b81c-4931-89ed-1c910eaf7219 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:29 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-32f5d8e2-b81c-4931-89ed-1c910eaf7219 Sep 16 17:48:29 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:29 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6 1073741824" returned: 0 in 0.545s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:29 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6 Sep 16 17:48:29 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:29 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2d1bf406-ff79-4117-95ca-74bf00d299c8 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-32f5d8e2-b81c-4931-89ed-1c910eaf7219" returned: 0 in 0.418s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2d1bf406-ff79-4117-95ca-74bf00d299c8 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-32f5d8e2-b81c-4931-89ed-1c910eaf7219 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:29 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-32f5d8e2-b81c-4931-89ed-1c910eaf7219 Sep 16 17:48:29 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:29 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6" returned: 0 in 0.287s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a2c7e1-a5c6-407f-ae77-486a64ecd514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60399b15-b099-4a28-b63c-856dd9f232d6', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2677966-e168-413a-a578-a1b70576a072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:48:29 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Volume volume-60399b15-b099-4a28-b63c-856dd9f232d6 (60399b15-b099-4a28-b63c-856dd9f232d6): created successfully Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2677966-e168-413a-a578-a1b70576a072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Flow 'volume_create_manager' (4b403b9b-12f2-4782-ac5b-e071ea0bd3c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:48:29 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-be8e594d-d0c2-49f1-ac53-90fbafef1eb1 tempest-TestImageHashVerification-1430584777 None] Created volume successfully. Sep 16 17:48:29 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2d1bf406-ff79-4117-95ca-74bf00d299c8 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-32f5d8e2-b81c-4931-89ed-1c910eaf7219" returned: 0 in 0.292s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2d1bf406-ff79-4117-95ca-74bf00d299c8 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-32f5d8e2-b81c-4931-89ed-1c910eaf7219" released by "delete_volume" :: held 0.763s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-2d1bf406-ff79-4117-95ca-74bf00d299c8 tempest-VolumesSnapshotTestJSON-77441170 None] Created reservations ['25d2187e-10e0-4cbc-977d-1cdb873d9625', 'fb314515-a785-4f4a-880e-5cd46a75be0e', 'bb539705-5db3-4e5b-b063-cf1e916b2641', 'da65a6a0-7634-4cbf-a12c-e10c5ba5f007'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2d1bf406-ff79-4117-95ca-74bf00d299c8 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2d1bf406-ff79-4117-95ca-74bf00d299c8 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2d1bf406-ff79-4117-95ca-74bf00d299c8 tempest-VolumesSnapshotTestJSON-77441170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2d1bf406-ff79-4117-95ca-74bf00d299c8 tempest-VolumesSnapshotTestJSON-77441170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2d1bf406-ff79-4117-95ca-74bf00d299c8 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2d1bf406-ff79-4117-95ca-74bf00d299c8 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:29 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:48:29 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:29 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2d1bf406-ff79-4117-95ca-74bf00d299c8 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.262s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-2d1bf406-ff79-4117-95ca-74bf00d299c8 tempest-VolumesSnapshotTestJSON-77441170 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-554408bd-1e6a-45d9-aac9-acbd460c33db tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "cinder-0d5b50df-2568-4259-b39b-457cd095c3e9-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:48:29 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-2d1bf406-ff79-4117-95ca-74bf00d299c8 tempest-VolumesSnapshotTestJSON-77441170 None] Deleted volume successfully. Sep 16 17:48:29 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-554408bd-1e6a-45d9-aac9-acbd460c33db tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-0d5b50df-2568-4259-b39b-457cd095c3e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:48:30 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-554408bd-1e6a-45d9-aac9-acbd460c33db tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "cinder-quobyte-5a70af72-f4c4-4f8c-8091-a2bb523c947f" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:48:30 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2d1bf406-ff79-4117-95ca-74bf00d299c8 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-32f5d8e2-b81c-4931-89ed-1c910eaf7219-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:48:30 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-554408bd-1e6a-45d9-aac9-acbd460c33db tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-5a70af72-f4c4-4f8c-8091-a2bb523c947f" acquired by "delete_snapshot" :: waited 0.032s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:48:30 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-554408bd-1e6a-45d9-aac9-acbd460c33db tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "cinder-quobyte-0d5b50df-2568-4259-b39b-457cd095c3e9" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:48:30 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-554408bd-1e6a-45d9-aac9-acbd460c33db tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-0d5b50df-2568-4259-b39b-457cd095c3e9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:48:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-554408bd-1e6a-45d9-aac9-acbd460c33db tempest-VolumesSnapshotTestJSON-77441170 None] Deleting offline snapshot 0d5b50df-2568-4259-b39b-457cd095c3e9 of volume 5a70af72-f4c4-4f8c-8091-a2bb523c947f {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:48:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-554408bd-1e6a-45d9-aac9-acbd460c33db tempest-VolumesSnapshotTestJSON-77441170 None] snapshot_file for this snap is: volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.0d5b50df-2568-4259-b39b-457cd095c3e9 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:48:30 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcf970d-4e2a-47df-8bd4-f087d70a73d2]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:48:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-554408bd-1e6a-45d9-aac9-acbd460c33db tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.0d5b50df-2568-4259-b39b-457cd095c3e9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:30 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.0d5b50df-2568-4259-b39b-457cd095c3e9 Sep 16 17:48:30 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:30 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-554408bd-1e6a-45d9-aac9-acbd460c33db tempest-VolumesSnapshotTestJSON-77441170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.0d5b50df-2568-4259-b39b-457cd095c3e9" returned: 0 in 0.356s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-554408bd-1e6a-45d9-aac9-acbd460c33db tempest-VolumesSnapshotTestJSON-77441170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:48:30 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d476d8-785e-41c1-b3db-f42701e8004c]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:48:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-554408bd-1e6a-45d9-aac9-acbd460c33db tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:30 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f Sep 16 17:48:30 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:31 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-554408bd-1e6a-45d9-aac9-acbd460c33db tempest-VolumesSnapshotTestJSON-77441170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f" returned: 0 in 0.618s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-554408bd-1e6a-45d9-aac9-acbd460c33db tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.0d5b50df-2568-4259-b39b-457cd095c3e9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:31 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.0d5b50df-2568-4259-b39b-457cd095c3e9 Sep 16 17:48:31 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:31 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-554408bd-1e6a-45d9-aac9-acbd460c33db tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.0d5b50df-2568-4259-b39b-457cd095c3e9" returned: 0 in 0.417s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-554408bd-1e6a-45d9-aac9-acbd460c33db tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.0d5b50df-2568-4259-b39b-457cd095c3e9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d6ec8c09-f6e8-4505-8cf9-83a2dea40f24 tempest-TestImageHashVerification-1430584777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:48:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d6ec8c09-f6e8-4505-8cf9-83a2dea40f24 tempest-TestImageHashVerification-1430584777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:48:31 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.0d5b50df-2568-4259-b39b-457cd095c3e9 Sep 16 17:48:31 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:31 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[70db7d94-151a-4d75-9d88-156eb26146d9]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:48:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d6ec8c09-f6e8-4505-8cf9-83a2dea40f24 tempest-TestImageHashVerification-1430584777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:31 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6 Sep 16 17:48:31 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:31 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-554408bd-1e6a-45d9-aac9-acbd460c33db tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f.0d5b50df-2568-4259-b39b-457cd095c3e9" returned: 0 in 0.271s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-554408bd-1e6a-45d9-aac9-acbd460c33db tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-0d5b50df-2568-4259-b39b-457cd095c3e9" released by "_delete_snapshot" :: held 1.812s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:48:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-554408bd-1e6a-45d9-aac9-acbd460c33db tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-5a70af72-f4c4-4f8c-8091-a2bb523c947f" released by "delete_snapshot" :: held 1.843s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:48:31 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-554408bd-1e6a-45d9-aac9-acbd460c33db tempest-VolumesSnapshotTestJSON-77441170 None] Created reservations ['95269b0a-a529-498c-86d6-cc2477479d42', 'a5e44495-0def-47f7-b790-4ad84226856a', '69886fa0-7c54-41b4-b084-325a77fc782d', 'ae3fb3b0-16b6-4527-973b-1cb420cc3ab3'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:48:31 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d6ec8c09-f6e8-4505-8cf9-83a2dea40f24 tempest-TestImageHashVerification-1430584777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6" returned: 0 in 0.411s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:32 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30ae970-04e0-47f5-b56a-4df327d90c95]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:48:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d6ec8c09-f6e8-4505-8cf9-83a2dea40f24 tempest-TestImageHashVerification-1430584777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:32 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-554408bd-1e6a-45d9-aac9-acbd460c33db tempest-VolumesSnapshotTestJSON-77441170 None] Delete snapshot completed successfully. Sep 16 17:48:32 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-554408bd-1e6a-45d9-aac9-acbd460c33db tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-0d5b50df-2568-4259-b39b-457cd095c3e9-delete_snapshot" released by "delete_snapshot" :: held 2.060s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:48:32 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6 Sep 16 17:48:32 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:32 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-92a2c053-be9a-4b33-9525-b9a3f4143b48 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "cinder-5a70af72-f4c4-4f8c-8091-a2bb523c947f-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:48:32 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-92a2c053-be9a-4b33-9525-b9a3f4143b48 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-5a70af72-f4c4-4f8c-8091-a2bb523c947f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:48:32 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-92a2c053-be9a-4b33-9525-b9a3f4143b48 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "cinder-quobyte-5a70af72-f4c4-4f8c-8091-a2bb523c947f" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:48:32 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-92a2c053-be9a-4b33-9525-b9a3f4143b48 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-5a70af72-f4c4-4f8c-8091-a2bb523c947f" acquired by "delete_volume" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:48:32 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1217522-4ed8-432a-979c-bf43f7ded901]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:48:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-92a2c053-be9a-4b33-9525-b9a3f4143b48 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:32 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d6ec8c09-f6e8-4505-8cf9-83a2dea40f24 tempest-TestImageHashVerification-1430584777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6" returned: 0 in 0.414s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d6ec8c09-f6e8-4505-8cf9-83a2dea40f24 tempest-TestImageHashVerification-1430584777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6 /opt/stack/data/cinder/conversion/60399b15-b099-4a28-b63c-856dd9f232d6.temp_image.ef82439f-f163-4837-88bf-c4f3a7b2d6c01156dly8.img {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:32 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6 /opt/stack/data/cinder/conversion/60399b15-b099-4a28-b63c-856dd9f232d6.temp_image.ef82439f-f163-4837-88bf-c4f3a7b2d6c01156dly8.img Sep 16 17:48:32 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:32 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f Sep 16 17:48:32 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:32 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-92a2c053-be9a-4b33-9525-b9a3f4143b48 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f" returned: 0 in 0.543s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-92a2c053-be9a-4b33-9525-b9a3f4143b48 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:33 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f Sep 16 17:48:33 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:33 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-92a2c053-be9a-4b33-9525-b9a3f4143b48 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5a70af72-f4c4-4f8c-8091-a2bb523c947f" returned: 0 in 0.395s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:33 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-92a2c053-be9a-4b33-9525-b9a3f4143b48 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-5a70af72-f4c4-4f8c-8091-a2bb523c947f" released by "delete_volume" :: held 1.035s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:48:33 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-92a2c053-be9a-4b33-9525-b9a3f4143b48 tempest-VolumesSnapshotTestJSON-77441170 None] Created reservations ['aa8ac979-ed03-4bac-a3d5-10746565c68b', '0e791e95-13a6-4bac-a8db-eee9938033bf', 'fbe1a808-8c3c-4cfa-aa69-2a74da052d23', 'ea40d1a5-01b7-49ed-be05-8dcb4a917e74'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:48:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-92a2c053-be9a-4b33-9525-b9a3f4143b48 tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:48:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-92a2c053-be9a-4b33-9525-b9a3f4143b48 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:48:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-92a2c053-be9a-4b33-9525-b9a3f4143b48 tempest-VolumesSnapshotTestJSON-77441170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:48:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-92a2c053-be9a-4b33-9525-b9a3f4143b48 tempest-VolumesSnapshotTestJSON-77441170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:48:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-92a2c053-be9a-4b33-9525-b9a3f4143b48 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:48:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-92a2c053-be9a-4b33-9525-b9a3f4143b48 tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:33 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:48:33 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:34 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-92a2c053-be9a-4b33-9525-b9a3f4143b48 tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.430s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:34 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-92a2c053-be9a-4b33-9525-b9a3f4143b48 tempest-VolumesSnapshotTestJSON-77441170 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:48:34 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-92a2c053-be9a-4b33-9525-b9a3f4143b48 tempest-VolumesSnapshotTestJSON-77441170 None] Deleted volume successfully. Sep 16 17:48:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-92a2c053-be9a-4b33-9525-b9a3f4143b48 tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-5a70af72-f4c4-4f8c-8091-a2bb523c947f-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:48:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-dd738e46-3506-42df-9b04-bb38cddae2ad tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "cinder-5334f223-3b46-4997-a403-6dd28b255aec-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:48:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-dd738e46-3506-42df-9b04-bb38cddae2ad tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-5334f223-3b46-4997-a403-6dd28b255aec-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:48:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-dd738e46-3506-42df-9b04-bb38cddae2ad tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "cinder-quobyte-5334f223-3b46-4997-a403-6dd28b255aec" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:48:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-dd738e46-3506-42df-9b04-bb38cddae2ad tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-5334f223-3b46-4997-a403-6dd28b255aec" acquired by "delete_volume" :: waited 0.031s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:48:35 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[24edf9c9-5ca5-4cac-9235-ef4d81e8adc4]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:48:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dd738e46-3506-42df-9b04-bb38cddae2ad tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:35 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec Sep 16 17:48:35 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:35 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dd738e46-3506-42df-9b04-bb38cddae2ad tempest-VolumesSnapshotTestJSON-77441170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec" returned: 0 in 0.664s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dd738e46-3506-42df-9b04-bb38cddae2ad tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:35 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec Sep 16 17:48:35 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:36 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dd738e46-3506-42df-9b04-bb38cddae2ad tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5334f223-3b46-4997-a403-6dd28b255aec" returned: 0 in 0.605s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-dd738e46-3506-42df-9b04-bb38cddae2ad tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-quobyte-5334f223-3b46-4997-a403-6dd28b255aec" released by "delete_volume" :: held 1.482s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:48:36 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-dd738e46-3506-42df-9b04-bb38cddae2ad tempest-VolumesSnapshotTestJSON-77441170 None] Created reservations ['2725f180-6526-41d6-916a-4eebd7174e56', '8465cb60-fa3a-4ecf-bd22-fbb76212f752', 'b6eff0b9-f8a1-46cc-96bc-7ca9a6d5700d', '86795635-8135-4896-98c2-4c533aaf12c9'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:48:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-dd738e46-3506-42df-9b04-bb38cddae2ad tempest-VolumesSnapshotTestJSON-77441170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:48:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-dd738e46-3506-42df-9b04-bb38cddae2ad tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:48:36 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-dd738e46-3506-42df-9b04-bb38cddae2ad tempest-VolumesSnapshotTestJSON-77441170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:48:36 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-dd738e46-3506-42df-9b04-bb38cddae2ad tempest-VolumesSnapshotTestJSON-77441170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:48:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-dd738e46-3506-42df-9b04-bb38cddae2ad tempest-VolumesSnapshotTestJSON-77441170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:48:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dd738e46-3506-42df-9b04-bb38cddae2ad tempest-VolumesSnapshotTestJSON-77441170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:36 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:48:36 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:37 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dd738e46-3506-42df-9b04-bb38cddae2ad tempest-VolumesSnapshotTestJSON-77441170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.452s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:37 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-dd738e46-3506-42df-9b04-bb38cddae2ad tempest-VolumesSnapshotTestJSON-77441170 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:48:37 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-dd738e46-3506-42df-9b04-bb38cddae2ad tempest-VolumesSnapshotTestJSON-77441170 None] Deleted volume successfully. Sep 16 17:48:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-dd738e46-3506-42df-9b04-bb38cddae2ad tempest-VolumesSnapshotTestJSON-77441170 None] Lock "cinder-5334f223-3b46-4997-a403-6dd28b255aec-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:48:41 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d6ec8c09-f6e8-4505-8cf9-83a2dea40f24 tempest-TestImageHashVerification-1430584777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6 /opt/stack/data/cinder/conversion/60399b15-b099-4a28-b63c-856dd9f232d6.temp_image.ef82439f-f163-4837-88bf-c4f3a7b2d6c01156dly8.img" returned: 0 in 8.684s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:41 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce76fb1-52be-475f-ae2d-64a20de272f4]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:48:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d6ec8c09-f6e8-4505-8cf9-83a2dea40f24 tempest-TestImageHashVerification-1430584777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:48:41 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6 Sep 16 17:48:41 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:48:41 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Sep 16 17:48:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d6ec8c09-f6e8-4505-8cf9-83a2dea40f24 tempest-TestImageHashVerification-1430584777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6" returned: 0 in 0.630s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:48:41 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-d6ec8c09-f6e8-4505-8cf9-83a2dea40f24 tempest-TestImageHashVerification-1430584777 None] Image conversion details: src /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6, size 1024.00 MB, duration 8.69 sec, destination /opt/stack/data/cinder/conversion/60399b15-b099-4a28-b63c-856dd9f232d6.temp_image.ef82439f-f163-4837-88bf-c4f3a7b2d6c01156dly8.img {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:48:41 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-d6ec8c09-f6e8-4505-8cf9-83a2dea40f24 tempest-TestImageHashVerification-1430584777 None] Converted 1024.00 MB image at 117.90 MB/s Sep 16 17:48:41 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-d6ec8c09-f6e8-4505-8cf9-83a2dea40f24 tempest-TestImageHashVerification-1430584777 None] ef82439f-f163-4837-88bf-c4f3a7b2d6c0 was raw, no need to convert to raw {{(pid=85899) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 16 17:48:51 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:UPDATE=36,cinder:SELECT=22,cinder:INSERT=9 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:48:51 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=29,cinder:INSERT=9,cinder:DELETE=5,cinder:UPDATE=34 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:49:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:49:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:49:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:49:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:02 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:49:02 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:02 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.406s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:49:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager._thread_info {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:49:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread count: 28 {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:49:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread info: [<_MainThread(MainThread, started 123748124422272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:49:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d6ec8c09-f6e8-4505-8cf9-83a2dea40f24 tempest-TestImageHashVerification-1430584777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.353s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d6ec8c09-f6e8-4505-8cf9-83a2dea40f24 tempest-TestImageHashVerification-1430584777 None] Uploaded volume to glance image-id: ef82439f-f163-4837-88bf-c4f3a7b2d6c0. {{(pid=85899) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 16 17:49:06 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-d6ec8c09-f6e8-4505-8cf9-83a2dea40f24 tempest-TestImageHashVerification-1430584777 None] Copy volume to image completed successfully. Sep 16 17:49:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a833fc82-154a-4172-bef8-ad5faa23afb2 tempest-TestImageHashVerification-1430584777 None] Acquiring lock "cinder-60399b15-b099-4a28-b63c-856dd9f232d6-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a833fc82-154a-4172-bef8-ad5faa23afb2 tempest-TestImageHashVerification-1430584777 None] Lock "cinder-60399b15-b099-4a28-b63c-856dd9f232d6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a833fc82-154a-4172-bef8-ad5faa23afb2 tempest-TestImageHashVerification-1430584777 None] Acquiring lock "cinder-quobyte-60399b15-b099-4a28-b63c-856dd9f232d6" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a833fc82-154a-4172-bef8-ad5faa23afb2 tempest-TestImageHashVerification-1430584777 None] Lock "cinder-quobyte-60399b15-b099-4a28-b63c-856dd9f232d6" acquired by "delete_volume" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:08 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[000938a7-94bd-4a26-99b7-174dd48c1be4]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:49:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a833fc82-154a-4172-bef8-ad5faa23afb2 tempest-TestImageHashVerification-1430584777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:08 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6 Sep 16 17:49:08 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:09 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a833fc82-154a-4172-bef8-ad5faa23afb2 tempest-TestImageHashVerification-1430584777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6" returned: 0 in 0.626s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a833fc82-154a-4172-bef8-ad5faa23afb2 tempest-TestImageHashVerification-1430584777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:09 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6 Sep 16 17:49:09 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:09 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a833fc82-154a-4172-bef8-ad5faa23afb2 tempest-TestImageHashVerification-1430584777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-60399b15-b099-4a28-b63c-856dd9f232d6" returned: 0 in 0.344s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:09 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a833fc82-154a-4172-bef8-ad5faa23afb2 tempest-TestImageHashVerification-1430584777 None] Lock "cinder-quobyte-60399b15-b099-4a28-b63c-856dd9f232d6" released by "delete_volume" :: held 1.074s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:49:12 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-a833fc82-154a-4172-bef8-ad5faa23afb2 tempest-TestImageHashVerification-1430584777 None] Created reservations ['a873f550-1e44-4f84-9415-18a83c2bfa4d', '037e6882-e96b-4946-92d3-b327d93c464b', '309f0b5e-c2a4-4a94-8087-920c91a59544', 'a547ceb0-b2b2-46a0-9d9a-c12bf122b014'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:49:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a833fc82-154a-4172-bef8-ad5faa23afb2 tempest-TestImageHashVerification-1430584777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a833fc82-154a-4172-bef8-ad5faa23afb2 tempest-TestImageHashVerification-1430584777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a833fc82-154a-4172-bef8-ad5faa23afb2 tempest-TestImageHashVerification-1430584777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:49:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a833fc82-154a-4172-bef8-ad5faa23afb2 tempest-TestImageHashVerification-1430584777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:49:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a833fc82-154a-4172-bef8-ad5faa23afb2 tempest-TestImageHashVerification-1430584777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a833fc82-154a-4172-bef8-ad5faa23afb2 tempest-TestImageHashVerification-1430584777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:15 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:49:15 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:15 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a833fc82-154a-4172-bef8-ad5faa23afb2 tempest-TestImageHashVerification-1430584777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.374s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:15 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-a833fc82-154a-4172-bef8-ad5faa23afb2 tempest-TestImageHashVerification-1430584777 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:49:15 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-a833fc82-154a-4172-bef8-ad5faa23afb2 tempest-TestImageHashVerification-1430584777 None] Deleted volume successfully. Sep 16 17:49:15 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a833fc82-154a-4172-bef8-ad5faa23afb2 tempest-TestImageHashVerification-1430584777 None] Lock "cinder-60399b15-b099-4a28-b63c-856dd9f232d6-delete_volume" released by "delete_volume" :: held 7.069s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:49:20 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:49:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Flow 'volume_create_manager' (72b7c4e4-b71e-4c96-8cc7-b9a311e787b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e61c904-58d6-4f0f-ac9d-ce2387487ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e61c904-58d6-4f0f-ac9d-ce2387487ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1843554186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dafe099f-a461-4d78-96a1-dad4b65e287d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4479bad5abd849aab909bf2fcbd15733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:21Z,use_quota=True,user_id='1e32776d54b74e81bd75611b7ec6c399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605bacd4-c641-41fb-bbe0-bff41e948fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605bacd4-c641-41fb-bbe0-bff41e948fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2446afe-51be-4e5e-9802-0509b35c2132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2446afe-51be-4e5e-9802-0509b35c2132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dafe099f-a461-4d78-96a1-dad4b65e287d', 'volume_name': 'volume-dafe099f-a461-4d78-96a1-dad4b65e287d', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4795d4-643c-4f51-a9ae-41b5fd4c242e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4795d4-643c-4f51-a9ae-41b5fd4c242e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b0adc44-d9ea-4b67-9152-07ccca96a553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:20 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Volume dafe099f-a461-4d78-96a1-dad4b65e287d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dafe099f-a461-4d78-96a1-dad4b65e287d', 'volume_size': 1} Sep 16 17:49:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1843554186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dafe099f-a461-4d78-96a1-dad4b65e287d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4479bad5abd849aab909bf2fcbd15733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:21Z,use_quota=True,user_id='1e32776d54b74e81bd75611b7ec6c399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:49:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Creating volume dafe099f-a461-4d78-96a1-dad4b65e287d {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:49:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:49:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:49:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:49:20 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:49:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dafe099f-a461-4d78-96a1-dad4b65e287d 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:21 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dafe099f-a461-4d78-96a1-dad4b65e287d 1073741824 Sep 16 17:49:21 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:21 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dafe099f-a461-4d78-96a1-dad4b65e287d 1073741824" returned: 0 in 0.819s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dafe099f-a461-4d78-96a1-dad4b65e287d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:21 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dafe099f-a461-4d78-96a1-dad4b65e287d Sep 16 17:49:21 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:22 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dafe099f-a461-4d78-96a1-dad4b65e287d" returned: 0 in 0.300s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:49:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b0adc44-d9ea-4b67-9152-07ccca96a553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dafe099f-a461-4d78-96a1-dad4b65e287d', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a329d5-c4e4-4d1c-be7b-f266cb50b528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:22 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Volume volume-dafe099f-a461-4d78-96a1-dad4b65e287d (dafe099f-a461-4d78-96a1-dad4b65e287d): created successfully Sep 16 17:49:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a329d5-c4e4-4d1c-be7b-f266cb50b528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Flow 'volume_create_manager' (72b7c4e4-b71e-4c96-8cc7-b9a311e787b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:22 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-e4f25889-b534-40ac-9211-660b92a01905 tempest-VolumesActionsTest-2044150280 None] Created volume successfully. Sep 16 17:49:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-50cff39d-4adf-440a-9c64-307f63bc494d tempest-VolumesActionsTest-2044150280 None] Acquiring lock "cinder-dafe099f-a461-4d78-96a1-dad4b65e287d" by "attach_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-50cff39d-4adf-440a-9c64-307f63bc494d tempest-VolumesActionsTest-2044150280 None] Lock "cinder-dafe099f-a461-4d78-96a1-dad4b65e287d" acquired by "attach_volume" :: waited 0.029s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:23 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-50cff39d-4adf-440a-9c64-307f63bc494d tempest-VolumesActionsTest-2044150280 None] Attaching volume dafe099f-a461-4d78-96a1-dad4b65e287d to instance 82355ff9-d63f-4ebf-be21-5bd9385c2d51 at mountpoint /dev/vdb on host None. Sep 16 17:49:23 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-50cff39d-4adf-440a-9c64-307f63bc494d tempest-VolumesActionsTest-2044150280 None] Attach volume completed successfully. Sep 16 17:49:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-50cff39d-4adf-440a-9c64-307f63bc494d tempest-VolumesActionsTest-2044150280 None] Lock "cinder-dafe099f-a461-4d78-96a1-dad4b65e287d" released by "attach_volume" :: held 0.148s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:49:24 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-d25b8605-2e57-41ee-a82d-dde8ea8e7024 tempest-VolumesActionsTest-225420878 None] Terminate volume connection completed successfully. Sep 16 17:49:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d25b8605-2e57-41ee-a82d-dde8ea8e7024 tempest-VolumesActionsTest-225420878 None] Acquiring lock "cinder-dafe099f-a461-4d78-96a1-dad4b65e287d-detach_volume" by "detach_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d25b8605-2e57-41ee-a82d-dde8ea8e7024 tempest-VolumesActionsTest-225420878 None] Lock "cinder-dafe099f-a461-4d78-96a1-dad4b65e287d-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:24 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-d25b8605-2e57-41ee-a82d-dde8ea8e7024 tempest-VolumesActionsTest-225420878 None] Detaching volume dafe099f-a461-4d78-96a1-dad4b65e287d from instance 82355ff9-d63f-4ebf-be21-5bd9385c2d51. Sep 16 17:49:24 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-d25b8605-2e57-41ee-a82d-dde8ea8e7024 tempest-VolumesActionsTest-225420878 None] Detach volume completed successfully. Sep 16 17:49:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d25b8605-2e57-41ee-a82d-dde8ea8e7024 tempest-VolumesActionsTest-225420878 None] Lock "cinder-dafe099f-a461-4d78-96a1-dad4b65e287d-detach_volume" released by "detach_volume" :: held 0.076s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:49:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-20241e35-ab62-4bc4-a99c-ed639cdd9e70 tempest-VolumesActionsTest-2044150280 None] Acquiring lock "cinder-dafe099f-a461-4d78-96a1-dad4b65e287d-detach_volume" by "detach_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-20241e35-ab62-4bc4-a99c-ed639cdd9e70 tempest-VolumesActionsTest-2044150280 None] Lock "cinder-dafe099f-a461-4d78-96a1-dad4b65e287d-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:24 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-20241e35-ab62-4bc4-a99c-ed639cdd9e70 tempest-VolumesActionsTest-2044150280 None] Volume detach called, but volume not attached. Sep 16 17:49:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-20241e35-ab62-4bc4-a99c-ed639cdd9e70 tempest-VolumesActionsTest-2044150280 None] Lock "cinder-dafe099f-a461-4d78-96a1-dad4b65e287d-detach_volume" released by "detach_volume" :: held 0.019s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:49:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3ec658e2-2fe7-48aa-a611-9e65e6608aeb tempest-VolumesActionsTest-2044150280 None] Acquiring lock "cinder-dafe099f-a461-4d78-96a1-dad4b65e287d-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3ec658e2-2fe7-48aa-a611-9e65e6608aeb tempest-VolumesActionsTest-2044150280 None] Lock "cinder-dafe099f-a461-4d78-96a1-dad4b65e287d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3ec658e2-2fe7-48aa-a611-9e65e6608aeb tempest-VolumesActionsTest-2044150280 None] Acquiring lock "cinder-quobyte-dafe099f-a461-4d78-96a1-dad4b65e287d" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3ec658e2-2fe7-48aa-a611-9e65e6608aeb tempest-VolumesActionsTest-2044150280 None] Lock "cinder-quobyte-dafe099f-a461-4d78-96a1-dad4b65e287d" acquired by "delete_volume" :: waited 0.022s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:24 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d7b42a-32b8-4207-a7b2-cbe460c2f896]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:49:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3ec658e2-2fe7-48aa-a611-9e65e6608aeb tempest-VolumesActionsTest-2044150280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dafe099f-a461-4d78-96a1-dad4b65e287d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:24 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dafe099f-a461-4d78-96a1-dad4b65e287d Sep 16 17:49:24 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:25 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3ec658e2-2fe7-48aa-a611-9e65e6608aeb tempest-VolumesActionsTest-2044150280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dafe099f-a461-4d78-96a1-dad4b65e287d" returned: 0 in 0.490s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3ec658e2-2fe7-48aa-a611-9e65e6608aeb tempest-VolumesActionsTest-2044150280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dafe099f-a461-4d78-96a1-dad4b65e287d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:25 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dafe099f-a461-4d78-96a1-dad4b65e287d Sep 16 17:49:25 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:25 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3ec658e2-2fe7-48aa-a611-9e65e6608aeb tempest-VolumesActionsTest-2044150280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-dafe099f-a461-4d78-96a1-dad4b65e287d" returned: 0 in 0.288s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3ec658e2-2fe7-48aa-a611-9e65e6608aeb tempest-VolumesActionsTest-2044150280 None] Lock "cinder-quobyte-dafe099f-a461-4d78-96a1-dad4b65e287d" released by "delete_volume" :: held 0.842s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:49:25 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-3ec658e2-2fe7-48aa-a611-9e65e6608aeb tempest-VolumesActionsTest-2044150280 None] Created reservations ['3da4463f-4b15-46b6-a6b3-c84c026ed5d5', '04ee7af8-9943-40f4-91ec-5fd98be669b5', 'b7b82d3b-a5dc-4bb4-a208-80e760821fad', 'dabf6029-ef5b-41be-ad65-0fc3c6db1d84'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:49:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3ec658e2-2fe7-48aa-a611-9e65e6608aeb tempest-VolumesActionsTest-2044150280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3ec658e2-2fe7-48aa-a611-9e65e6608aeb tempest-VolumesActionsTest-2044150280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3ec658e2-2fe7-48aa-a611-9e65e6608aeb tempest-VolumesActionsTest-2044150280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:49:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3ec658e2-2fe7-48aa-a611-9e65e6608aeb tempest-VolumesActionsTest-2044150280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:49:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3ec658e2-2fe7-48aa-a611-9e65e6608aeb tempest-VolumesActionsTest-2044150280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3ec658e2-2fe7-48aa-a611-9e65e6608aeb tempest-VolumesActionsTest-2044150280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:25 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:49:25 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:26 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3ec658e2-2fe7-48aa-a611-9e65e6608aeb tempest-VolumesActionsTest-2044150280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.313s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:26 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-3ec658e2-2fe7-48aa-a611-9e65e6608aeb tempest-VolumesActionsTest-2044150280 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:49:26 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-3ec658e2-2fe7-48aa-a611-9e65e6608aeb tempest-VolumesActionsTest-2044150280 None] Deleted volume successfully. Sep 16 17:49:26 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3ec658e2-2fe7-48aa-a611-9e65e6608aeb tempest-VolumesActionsTest-2044150280 None] Lock "cinder-dafe099f-a461-4d78-96a1-dad4b65e287d-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:49:30 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:49:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Flow 'volume_create_manager' (04b5dc56-8162-433b-ae39-67954fad7739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b248a3f-d6cc-4576-b8df-fe63e04f51af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b248a3f-d6cc-4576-b8df-fe63e04f51af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1665709353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8532cbe1-b077-4762-910d-ba48eb9ca98f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4479bad5abd849aab909bf2fcbd15733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:30Z,use_quota=True,user_id='1e32776d54b74e81bd75611b7ec6c399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be10cdb1-3c39-4ab5-99ba-6fac96424026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be10cdb1-3c39-4ab5-99ba-6fac96424026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f37a8f-ab69-4882-b275-23c68680f662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f37a8f-ab69-4882-b275-23c68680f662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8532cbe1-b077-4762-910d-ba48eb9ca98f', 'volume_name': 'volume-8532cbe1-b077-4762-910d-ba48eb9ca98f', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd4412d-9512-496a-b57c-abcd2046daf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd4412d-9512-496a-b57c-abcd2046daf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:30 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2225ba36-c9b8-432a-8a5d-dc51074ed33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:30 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Volume 8532cbe1-b077-4762-910d-ba48eb9ca98f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8532cbe1-b077-4762-910d-ba48eb9ca98f', 'volume_size': 1} Sep 16 17:49:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1665709353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8532cbe1-b077-4762-910d-ba48eb9ca98f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4479bad5abd849aab909bf2fcbd15733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:30Z,use_quota=True,user_id='1e32776d54b74e81bd75611b7ec6c399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:49:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Creating volume 8532cbe1-b077-4762-910d-ba48eb9ca98f {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:49:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:49:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:49:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:49:30 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:49:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8532cbe1-b077-4762-910d-ba48eb9ca98f 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:30 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8532cbe1-b077-4762-910d-ba48eb9ca98f 1073741824 Sep 16 17:49:30 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:31 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8532cbe1-b077-4762-910d-ba48eb9ca98f 1073741824" returned: 0 in 0.501s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8532cbe1-b077-4762-910d-ba48eb9ca98f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:31 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8532cbe1-b077-4762-910d-ba48eb9ca98f Sep 16 17:49:31 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:31 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8532cbe1-b077-4762-910d-ba48eb9ca98f" returned: 0 in 0.310s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:31 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:49:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:31 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2225ba36-c9b8-432a-8a5d-dc51074ed33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8532cbe1-b077-4762-910d-ba48eb9ca98f', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:31 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b03d74-f649-416d-97c5-9cf4acca8baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:31 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Volume volume-8532cbe1-b077-4762-910d-ba48eb9ca98f (8532cbe1-b077-4762-910d-ba48eb9ca98f): created successfully Sep 16 17:49:31 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b03d74-f649-416d-97c5-9cf4acca8baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:31 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Flow 'volume_create_manager' (04b5dc56-8162-433b-ae39-67954fad7739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:31 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-975da33f-68da-45f6-988f-a05a6edc9c94 tempest-VolumesActionsTest-2044150280 None] Created volume successfully. Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Flow 'volume_create_manager' (0d1de4ee-30a9-42fc-9184-6575df69262c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58575801-904f-4085-b48b-d07381230113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58575801-904f-4085-b48b-d07381230113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1348263761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58169307-2909-4356-b97f-2a20894058dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a179e54eba4492380de8bd88d82c6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:32Z,use_quota=True,user_id='ee2112449b2e4169b0e0901646832ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8035317f-07be-4d9f-b5fb-5b9cb41ca447),volume_type_id=8035317f-07be-4d9f-b5fb-5b9cb41ca447)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016afef7-18ee-4bc5-998f-93023fed29a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016afef7-18ee-4bc5-998f-93023fed29a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30830ce6-ee9b-4ced-afd9-0dd44eaa5047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30830ce6-ee9b-4ced-afd9-0dd44eaa5047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58169307-2909-4356-b97f-2a20894058dd', 'volume_name': 'volume-58169307-2909-4356-b97f-2a20894058dd', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2d2b1a-40d6-4ad3-b628-e3e2b39c21d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2d2b1a-40d6-4ad3-b628-e3e2b39c21d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ab75c4-e827-41c3-8457-c67cbe1bc3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:32 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Volume 58169307-2909-4356-b97f-2a20894058dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58169307-2909-4356-b97f-2a20894058dd', 'volume_size': 1} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1348263761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58169307-2909-4356-b97f-2a20894058dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a179e54eba4492380de8bd88d82c6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:32Z,use_quota=True,user_id='ee2112449b2e4169b0e0901646832ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8035317f-07be-4d9f-b5fb-5b9cb41ca447),volume_type_id=8035317f-07be-4d9f-b5fb-5b9cb41ca447)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Creating volume 58169307-2909-4356-b97f-2a20894058dd {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:49:32 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-58169307-2909-4356-b97f-2a20894058dd 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:32 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-58169307-2909-4356-b97f-2a20894058dd 1073741824 Sep 16 17:49:32 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Flow 'volume_create_manager' (856f7dca-455b-4893-bd9c-96cc8fd78539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f94ad06-fd6b-49b2-8eca-298936e2a20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f94ad06-fd6b-49b2-8eca-298936e2a20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1135924310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d877794a-fcca-4fc0-9363-3ef36a113e9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a179e54eba4492380de8bd88d82c6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:32Z,use_quota=True,user_id='ee2112449b2e4169b0e0901646832ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b567cda1-ba8b-411f-b88e-a7d024b2e855),volume_type_id=b567cda1-ba8b-411f-b88e-a7d024b2e855)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc548e2-7266-4ac5-a6bf-7dd3260bbbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc548e2-7266-4ac5-a6bf-7dd3260bbbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15c03db-1dea-48bd-9859-2dba4b714cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15c03db-1dea-48bd-9859-2dba4b714cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd877794a-fcca-4fc0-9363-3ef36a113e9a', 'volume_name': 'volume-d877794a-fcca-4fc0-9363-3ef36a113e9a', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c20402-e864-4431-967a-a4d714fa4479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c20402-e864-4431-967a-a4d714fa4479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c7813f-0da6-4a62-be0f-472a4e5cca4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:32 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Volume d877794a-fcca-4fc0-9363-3ef36a113e9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d877794a-fcca-4fc0-9363-3ef36a113e9a', 'volume_size': 1} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:32 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-58169307-2909-4356-b97f-2a20894058dd 1073741824" returned: 0 in 0.547s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-58169307-2909-4356-b97f-2a20894058dd {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:32 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-58169307-2909-4356-b97f-2a20894058dd Sep 16 17:49:32 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-209d9a45-714c-4c94-b2f4-4d9b5090c4c1 tempest-VolumesActionsTest-225420878 None] Acquiring lock "cinder-8532cbe1-b077-4762-910d-ba48eb9ca98f-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-209d9a45-714c-4c94-b2f4-4d9b5090c4c1 tempest-VolumesActionsTest-225420878 None] Lock "cinder-8532cbe1-b077-4762-910d-ba48eb9ca98f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-209d9a45-714c-4c94-b2f4-4d9b5090c4c1 tempest-VolumesActionsTest-225420878 None] Acquiring lock "cinder-quobyte-8532cbe1-b077-4762-910d-ba48eb9ca98f" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-209d9a45-714c-4c94-b2f4-4d9b5090c4c1 tempest-VolumesActionsTest-225420878 None] Lock "cinder-quobyte-8532cbe1-b077-4762-910d-ba48eb9ca98f" acquired by "delete_volume" :: waited 0.038s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f8e076-d205-4186-8c3d-21ec89f7b1fa]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:49:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-209d9a45-714c-4c94-b2f4-4d9b5090c4c1 tempest-VolumesActionsTest-225420878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8532cbe1-b077-4762-910d-ba48eb9ca98f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:33 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8532cbe1-b077-4762-910d-ba48eb9ca98f Sep 16 17:49:33 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:33 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-58169307-2909-4356-b97f-2a20894058dd" returned: 0 in 0.403s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.619s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1135924310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d877794a-fcca-4fc0-9363-3ef36a113e9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a179e54eba4492380de8bd88d82c6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:32Z,use_quota=True,user_id='ee2112449b2e4169b0e0901646832ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b567cda1-ba8b-411f-b88e-a7d024b2e855),volume_type_id=b567cda1-ba8b-411f-b88e-a7d024b2e855)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Creating volume d877794a-fcca-4fc0-9363-3ef36a113e9a {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:49:33 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d877794a-fcca-4fc0-9363-3ef36a113e9a 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:33 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d877794a-fcca-4fc0-9363-3ef36a113e9a 1073741824 Sep 16 17:49:33 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ab75c4-e827-41c3-8457-c67cbe1bc3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58169307-2909-4356-b97f-2a20894058dd', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (589c2936-a5b2-48be-88de-fd30b9be2912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:33 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Volume volume-58169307-2909-4356-b97f-2a20894058dd (58169307-2909-4356-b97f-2a20894058dd): created successfully Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (589c2936-a5b2-48be-88de-fd30b9be2912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Flow 'volume_create_manager' (0d1de4ee-30a9-42fc-9184-6575df69262c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:33 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-b474e9f0-5d3f-4290-b632-d9a97380017b tempest-TestInstancesWithCinderVolumes-991321737 None] Created volume successfully. Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Flow 'volume_create_manager' (df8e1004-9c13-4952-b5bb-40444b73cf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4340928a-7e6d-427e-adaf-2030a870c2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4340928a-7e6d-427e-adaf-2030a870c2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-672347908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=167a5d07-ba57-4afe-a015-ff20e0e50328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a179e54eba4492380de8bd88d82c6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:33Z,use_quota=True,user_id='ee2112449b2e4169b0e0901646832ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21dea343-2a60-40e8-aad8-95fd60799047),volume_type_id=21dea343-2a60-40e8-aad8-95fd60799047)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d764182-9b51-42cc-8641-237910f9cc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d764182-9b51-42cc-8641-237910f9cc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b5214b-2cc9-4637-a0e2-9e0c8c9748bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.image.glance [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Creating Keystone auth plugin from conf {{(pid=85899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 17:49:33 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-209d9a45-714c-4c94-b2f4-4d9b5090c4c1 tempest-VolumesActionsTest-225420878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8532cbe1-b077-4762-910d-ba48eb9ca98f" returned: 0 in 0.495s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-209d9a45-714c-4c94-b2f4-4d9b5090c4c1 tempest-VolumesActionsTest-225420878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8532cbe1-b077-4762-910d-ba48eb9ca98f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:33 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8532cbe1-b077-4762-910d-ba48eb9ca98f Sep 16 17:49:33 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b5214b-2cc9-4637-a0e2-9e0c8c9748bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '167a5d07-ba57-4afe-a015-ff20e0e50328', 'volume_name': 'volume-167a5d07-ba57-4afe-a015-ff20e0e50328', 'volume_size': 1, 'image_id': '8612c93d-e0df-4252-9c6f-6d5237dc6f18', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8612c93d-e0df-4252-9c6f-6d5237dc6f18', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1429503775', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8a179e54eba4492380de8bd88d82c6e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8612c93d-e0df-4252-9c6f-6d5237dc6f18', 'created_at': datetime.datetime(2026, 9, 16, 15, 49, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 49, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8612c93d-e0df-4252-9c6f-6d5237dc6f18/file', 'properties': {}}, 'image_service': }' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c25f08b-4010-4cd9-a3a1-b969d36cf20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c25f08b-4010-4cd9-a3a1-b969d36cf20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f48948-b3bc-4d47-8df5-3d76b89360c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:33 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Volume 167a5d07-ba57-4afe-a015-ff20e0e50328: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-167a5d07-ba57-4afe-a015-ff20e0e50328', 'volume_size': 1, 'image_id': '8612c93d-e0df-4252-9c6f-6d5237dc6f18', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8612c93d-e0df-4252-9c6f-6d5237dc6f18', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1429503775', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8a179e54eba4492380de8bd88d82c6e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8612c93d-e0df-4252-9c6f-6d5237dc6f18', 'created_at': datetime.datetime(2026, 9, 16, 15, 49, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 49, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8612c93d-e0df-4252-9c6f-6d5237dc6f18/file', 'properties': {}}, 'image_service': } Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Trying to clone 167a5d07-ba57-4afe-a015-ff20e0e50328 from image 8612c93d-e0df-4252-9c6f-6d5237dc6f18 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8612c93d-e0df-4252-9c6f-6d5237dc6f18', 'metadata': {}}]). {{(pid=85899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 17:49:33 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d877794a-fcca-4fc0-9363-3ef36a113e9a 1073741824" returned: 0 in 0.600s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:33 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-209d9a45-714c-4c94-b2f4-4d9b5090c4c1 tempest-VolumesActionsTest-225420878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8532cbe1-b077-4762-910d-ba48eb9ca98f" returned: 0 in 0.316s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-209d9a45-714c-4c94-b2f4-4d9b5090c4c1 tempest-VolumesActionsTest-225420878 None] Lock "cinder-quobyte-8532cbe1-b077-4762-910d-ba48eb9ca98f" released by "delete_volume" :: held 0.887s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d877794a-fcca-4fc0-9363-3ef36a113e9a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:33 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d877794a-fcca-4fc0-9363-3ef36a113e9a Sep 16 17:49:33 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-209d9a45-714c-4c94-b2f4-4d9b5090c4c1 tempest-VolumesActionsTest-225420878 None] Created reservations ['25263ffe-c118-4e55-a2c6-c18a01a85c5d', '74e2132e-79cb-4bdf-a4d8-bd961b81b538', 'f32042c0-9cb6-4d4c-a526-78711e273254', '2c44f110-f452-4c2c-a640-21317163b5ef'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-209d9a45-714c-4c94-b2f4-4d9b5090c4c1 tempest-VolumesActionsTest-225420878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-209d9a45-714c-4c94-b2f4-4d9b5090c4c1 tempest-VolumesActionsTest-225420878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-209d9a45-714c-4c94-b2f4-4d9b5090c4c1 tempest-VolumesActionsTest-225420878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-209d9a45-714c-4c94-b2f4-4d9b5090c4c1 tempest-VolumesActionsTest-225420878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-209d9a45-714c-4c94-b2f4-4d9b5090c4c1 tempest-VolumesActionsTest-225420878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-209d9a45-714c-4c94-b2f4-4d9b5090c4c1 tempest-VolumesActionsTest-225420878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:34 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:49:34 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:34 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d877794a-fcca-4fc0-9363-3ef36a113e9a" returned: 0 in 0.318s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c7813f-0da6-4a62-be0f-472a4e5cca4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d877794a-fcca-4fc0-9363-3ef36a113e9a', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc2b95f-6e0f-4566-8a7b-624413a55d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:34 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Volume volume-d877794a-fcca-4fc0-9363-3ef36a113e9a (d877794a-fcca-4fc0-9363-3ef36a113e9a): created successfully Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc2b95f-6e0f-4566-8a7b-624413a55d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Flow 'volume_create_manager' (856f7dca-455b-4893-bd9c-96cc8fd78539) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:34 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-02827e0b-c184-4f54-8f9b-3b83697ab710 tempest-TestInstancesWithCinderVolumes-991321737 None] Created volume successfully. Sep 16 17:49:34 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-209d9a45-714c-4c94-b2f4-4d9b5090c4c1 tempest-VolumesActionsTest-225420878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.345s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-209d9a45-714c-4c94-b2f4-4d9b5090c4c1 tempest-VolumesActionsTest-225420878 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:49:34 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-209d9a45-714c-4c94-b2f4-4d9b5090c4c1 tempest-VolumesActionsTest-225420878 None] Deleted volume successfully. Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-209d9a45-714c-4c94-b2f4-4d9b5090c4c1 tempest-VolumesActionsTest-225420878 None] Lock "cinder-8532cbe1-b077-4762-910d-ba48eb9ca98f-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Flow 'volume_create_manager' (04534321-3b90-4174-9d45-13a712ccb6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5df033f-62ba-49d0-9e02-502a6a834f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5df033f-62ba-49d0-9e02-502a6a834f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1738509123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a814025-9e79-43ab-a2b4-89bc2eb2caa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4479bad5abd849aab909bf2fcbd15733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:35Z,use_quota=True,user_id='1e32776d54b74e81bd75611b7ec6c399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0970bc5f-fdd3-43c5-b025-d583121b826d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0970bc5f-fdd3-43c5-b025-d583121b826d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930c2345-9f84-40f8-a71b-40bcbe99a591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930c2345-9f84-40f8-a71b-40bcbe99a591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a814025-9e79-43ab-a2b4-89bc2eb2caa9', 'volume_name': 'volume-8a814025-9e79-43ab-a2b4-89bc2eb2caa9', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8436ee09-be49-437e-9925-8152564c56bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8436ee09-be49-437e-9925-8152564c56bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baabdfd9-27c6-4ae6-a11d-30494dc2290b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:34 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Volume 8a814025-9e79-43ab-a2b4-89bc2eb2caa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a814025-9e79-43ab-a2b4-89bc2eb2caa9', 'volume_size': 1} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1738509123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a814025-9e79-43ab-a2b4-89bc2eb2caa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4479bad5abd849aab909bf2fcbd15733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:35Z,use_quota=True,user_id='1e32776d54b74e81bd75611b7ec6c399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Creating volume 8a814025-9e79-43ab-a2b4-89bc2eb2caa9 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:49:34 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:49:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8a814025-9e79-43ab-a2b4-89bc2eb2caa9 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:34 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8a814025-9e79-43ab-a2b4-89bc2eb2caa9 1073741824 Sep 16 17:49:34 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:35 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Flow 'volume_create_manager' (901e2508-38b8-4b98-8e80-51dea751e7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b6c76a-b1fe-4635-bb59-82dfcf049c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8a814025-9e79-43ab-a2b4-89bc2eb2caa9 1073741824" returned: 0 in 0.587s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b6c76a-b1fe-4635-bb59-82dfcf049c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ebbbf67-2be4-424f-8424-9acd52a86b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6669775540bc4aa4908272dcdd517ed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:35Z,use_quota=True,user_id='75172fdb3cfe48edac3a9a380a03905d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc606d9-7186-4895-bbc6-08fd4f121127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc606d9-7186-4895-bbc6-08fd4f121127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5759cda2-03a7-4027-92f3-16e04cfffbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG cinder.image.glance [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Creating Keystone auth plugin from conf {{(pid=85899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8a814025-9e79-43ab-a2b4-89bc2eb2caa9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:35 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8a814025-9e79-43ab-a2b4-89bc2eb2caa9 Sep 16 17:49:35 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5759cda2-03a7-4027-92f3-16e04cfffbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3ebbbf67-2be4-424f-8424-9acd52a86b48', 'volume_name': 'volume-3ebbbf67-2be4-424f-8424-9acd52a86b48', 'volume_size': 1, 'image_id': 'a44d2a15-db29-401c-879f-dad6e2182d6c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a44d2a15-db29-401c-879f-dad6e2182d6c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9994fc06bd45d377a05c39be89146207', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6669775540bc4aa4908272dcdd517ed7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7aa85aff035fceb1cdcc1efc1df247f84e267100b2abdeccbe6935016418a66d287923269ea4ffb7108f9655c298317767830f60957b3f8f93007d3151080e63', 'id': 'a44d2a15-db29-401c-879f-dad6e2182d6c', 'created_at': datetime.datetime(2026, 9, 16, 15, 49, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 49, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a44d2a15-db29-401c-879f-dad6e2182d6c/file', 'properties': {}}, 'image_service': }' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234c33b3-6224-466c-8ab6-176a122c1376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234c33b3-6224-466c-8ab6-176a122c1376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7daac3d2-e623-4aad-b9c3-cab11296657b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:35 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Volume 3ebbbf67-2be4-424f-8424-9acd52a86b48: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3ebbbf67-2be4-424f-8424-9acd52a86b48', 'volume_size': 1, 'image_id': 'a44d2a15-db29-401c-879f-dad6e2182d6c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a44d2a15-db29-401c-879f-dad6e2182d6c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9994fc06bd45d377a05c39be89146207', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6669775540bc4aa4908272dcdd517ed7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7aa85aff035fceb1cdcc1efc1df247f84e267100b2abdeccbe6935016418a66d287923269ea4ffb7108f9655c298317767830f60957b3f8f93007d3151080e63', 'id': 'a44d2a15-db29-401c-879f-dad6e2182d6c', 'created_at': datetime.datetime(2026, 9, 16, 15, 49, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 49, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a44d2a15-db29-401c-879f-dad6e2182d6c/file', 'properties': {}}, 'image_service': } Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Trying to clone 3ebbbf67-2be4-424f-8424-9acd52a86b48 from image a44d2a15-db29-401c-879f-dad6e2182d6c at location (None, [{'url': 'file:///opt/stack/data/glance/images/a44d2a15-db29-401c-879f-dad6e2182d6c', 'metadata': {}}]). {{(pid=85899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 17:49:35 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8a814025-9e79-43ab-a2b4-89bc2eb2caa9" returned: 0 in 0.295s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baabdfd9-27c6-4ae6-a11d-30494dc2290b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a814025-9e79-43ab-a2b4-89bc2eb2caa9', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466b9a68-6e93-4b5a-8b1a-5ab7dcabfdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:35 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Volume volume-8a814025-9e79-43ab-a2b4-89bc2eb2caa9 (8a814025-9e79-43ab-a2b4-89bc2eb2caa9): created successfully Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466b9a68-6e93-4b5a-8b1a-5ab7dcabfdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Flow 'volume_create_manager' (04534321-3b90-4174-9d45-13a712ccb6f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 16 17:49:35 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Image download 0.00 MB at 0.00 MB/s Sep 16 17:49:35 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-60f31630-65de-4668-8c49-970eaed694b0 tempest-VolumesActionsTest-2044150280 None] Created volume successfully. Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c684393a-1f23-4abe-aad0-241528736319]: (4, 'raw') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:49:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:36 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD Sep 16 17:49:36 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:36 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:36 devstack sudo[99105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD Sep 16 17:49:36 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:36 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD" returned: 1 in 0.330s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD' failed. Not Retrying. {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:49:36 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Temporary image a44d2a15-db29-401c-879f-dad6e2182d6c is fetched for user 75172fdb3cfe48edac3a9a380a03905d. {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 16 17:49:36 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[19358fbb-6851-4e18-8285-c72214875cd1]: (4, 'raw') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:49:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:36 devstack sudo[99110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD Sep 16 17:49:36 devstack sudo[99110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-99ee5c6e-5e55-4ce1-802e-e95d8603f17b tempest-VolumesActionsTest-225420878 None] Acquiring lock "cinder-8a814025-9e79-43ab-a2b4-89bc2eb2caa9-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-99ee5c6e-5e55-4ce1-802e-e95d8603f17b tempest-VolumesActionsTest-225420878 None] Lock "cinder-8a814025-9e79-43ab-a2b4-89bc2eb2caa9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:37 devstack sudo[99110]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-99ee5c6e-5e55-4ce1-802e-e95d8603f17b tempest-VolumesActionsTest-225420878 None] Acquiring lock "cinder-quobyte-8a814025-9e79-43ab-a2b4-89bc2eb2caa9" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-99ee5c6e-5e55-4ce1-802e-e95d8603f17b tempest-VolumesActionsTest-225420878 None] Lock "cinder-quobyte-8a814025-9e79-43ab-a2b4-89bc2eb2caa9" acquired by "delete_volume" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adac924-0eae-4a62-bc9c-3f609394f0d2]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-99ee5c6e-5e55-4ce1-802e-e95d8603f17b tempest-VolumesActionsTest-225420878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8a814025-9e79-43ab-a2b4-89bc2eb2caa9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:37 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD Sep 16 17:49:37 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:37 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8a814025-9e79-43ab-a2b4-89bc2eb2caa9 Sep 16 17:49:37 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:37 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD" returned: 1 in 0.410s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD' failed. Not Retrying. {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ebbbf67-2be4-424f-8424-9acd52a86b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6669775540bc4aa4908272dcdd517ed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:35Z,use_quota=True,user_id='75172fdb3cfe48edac3a9a380a03905d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Creating volume 3ebbbf67-2be4-424f-8424-9acd52a86b48 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:49:37 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ebbbf67-2be4-424f-8424-9acd52a86b48 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:37 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ebbbf67-2be4-424f-8424-9acd52a86b48 1073741824 Sep 16 17:49:37 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:37 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-99ee5c6e-5e55-4ce1-802e-e95d8603f17b tempest-VolumesActionsTest-225420878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8a814025-9e79-43ab-a2b4-89bc2eb2caa9" returned: 0 in 0.414s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-99ee5c6e-5e55-4ce1-802e-e95d8603f17b tempest-VolumesActionsTest-225420878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8a814025-9e79-43ab-a2b4-89bc2eb2caa9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:37 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8a814025-9e79-43ab-a2b4-89bc2eb2caa9 Sep 16 17:49:37 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:37 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-99ee5c6e-5e55-4ce1-802e-e95d8603f17b tempest-VolumesActionsTest-225420878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-8a814025-9e79-43ab-a2b4-89bc2eb2caa9" returned: 0 in 0.292s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-99ee5c6e-5e55-4ce1-802e-e95d8603f17b tempest-VolumesActionsTest-225420878 None] Lock "cinder-quobyte-8a814025-9e79-43ab-a2b4-89bc2eb2caa9" released by "delete_volume" :: held 0.758s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-99ee5c6e-5e55-4ce1-802e-e95d8603f17b tempest-VolumesActionsTest-225420878 None] Created reservations ['bf6c8823-6c99-4f5b-8b9a-f9c009f5437d', 'e1c20481-c305-4e06-b97e-77e171814dd9', 'fe4c2732-40a7-4a03-84b0-aa1b3706ed98', 'ea6dd3d9-895a-4533-9bd5-7d2c359f5352'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:49:37 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ebbbf67-2be4-424f-8424-9acd52a86b48 1073741824" returned: 0 in 0.486s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ebbbf67-2be4-424f-8424-9acd52a86b48 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:38 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ebbbf67-2be4-424f-8424-9acd52a86b48 Sep 16 17:49:38 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-99ee5c6e-5e55-4ce1-802e-e95d8603f17b tempest-VolumesActionsTest-225420878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-99ee5c6e-5e55-4ce1-802e-e95d8603f17b tempest-VolumesActionsTest-225420878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-99ee5c6e-5e55-4ce1-802e-e95d8603f17b tempest-VolumesActionsTest-225420878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-99ee5c6e-5e55-4ce1-802e-e95d8603f17b tempest-VolumesActionsTest-225420878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-99ee5c6e-5e55-4ce1-802e-e95d8603f17b tempest-VolumesActionsTest-225420878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-99ee5c6e-5e55-4ce1-802e-e95d8603f17b tempest-VolumesActionsTest-225420878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:38 devstack sudo[99135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:49:38 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:38 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ebbbf67-2be4-424f-8424-9acd52a86b48" returned: 0 in 0.303s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Attempting download of a44d2a15-db29-401c-879f-dad6e2182d6c ((None, [{'url': 'file:///opt/stack/data/glance/images/a44d2a15-db29-401c-879f-dad6e2182d6c', 'metadata': {}}])) to volume 3ebbbf67-2be4-424f-8424-9acd52a86b48. {{(pid=85899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8612c93d-e0df-4252-9c6f-6d5237dc6f18__3bi44v4devstack@QuobyteHD, size 20.69 MB, duration 4.69 sec {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 16 17:49:38 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Image download 20.69 MB at 4.41 MB/s Sep 16 17:49:38 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfd20d3-07be-477f-89a8-787bf66a6588]: (4, 'raw') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a44d2a15-db29-401c-879f-dad6e2182d6c_gg3mang_ {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-99ee5c6e-5e55-4ce1-802e-e95d8603f17b tempest-VolumesActionsTest-225420878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.380s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-99ee5c6e-5e55-4ce1-802e-e95d8603f17b tempest-VolumesActionsTest-225420878 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:49:38 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-99ee5c6e-5e55-4ce1-802e-e95d8603f17b tempest-VolumesActionsTest-225420878 None] Deleted volume successfully. Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3136e2-28fe-4ebc-9232-16df7f7126a3]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-99ee5c6e-5e55-4ce1-802e-e95d8603f17b tempest-VolumesActionsTest-225420878 None] Lock "cinder-8a814025-9e79-43ab-a2b4-89bc2eb2caa9-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8612c93d-e0df-4252-9c6f-6d5237dc6f18__3bi44v4devstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:38 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a44d2a15-db29-401c-879f-dad6e2182d6c_gg3mang_ Sep 16 17:49:38 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:38 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8612c93d-e0df-4252-9c6f-6d5237dc6f18__3bi44v4devstack@QuobyteHD Sep 16 17:49:38 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Flow 'volume_create_manager' (2e63b4cb-a32a-473f-8d9e-78c57da06848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f9a6ed6-7343-4661-a0d5-cd685120f29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:38 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a44d2a15-db29-401c-879f-dad6e2182d6c_gg3mang_" returned: 0 in 0.418s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a44d2a15-db29-401c-879f-dad6e2182d6c_gg3mang_ {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f9a6ed6-7343-4661-a0d5-cd685120f29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1329918184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb5c506-2059-4895-b6f4-afce7c3e9dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4479bad5abd849aab909bf2fcbd15733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:39Z,use_quota=True,user_id='1e32776d54b74e81bd75611b7ec6c399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951769ec-e5e7-47fd-92d8-d86d379cc059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:38 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951769ec-e5e7-47fd-92d8-d86d379cc059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db39c36-313a-403c-8de5-94d79ad1707a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db39c36-313a-403c-8de5-94d79ad1707a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccb5c506-2059-4895-b6f4-afce7c3e9dbb', 'volume_name': 'volume-ccb5c506-2059-4895-b6f4-afce7c3e9dbb', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d0245c-3582-44b7-b2b3-f22a21e4f5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d0245c-3582-44b7-b2b3-f22a21e4f5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee17bff8-fce7-4bc8-b847-4613a5c1ee59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:38 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Volume ccb5c506-2059-4895-b6f4-afce7c3e9dbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccb5c506-2059-4895-b6f4-afce7c3e9dbb', 'volume_size': 1} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1329918184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb5c506-2059-4895-b6f4-afce7c3e9dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4479bad5abd849aab909bf2fcbd15733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:39Z,use_quota=True,user_id='1e32776d54b74e81bd75611b7ec6c399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Creating volume ccb5c506-2059-4895-b6f4-afce7c3e9dbb {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:49:38 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ccb5c506-2059-4895-b6f4-afce7c3e9dbb 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8612c93d-e0df-4252-9c6f-6d5237dc6f18__3bi44v4devstack@QuobyteHD" returned: 0 in 0.434s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:38 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Temporary image 8612c93d-e0df-4252-9c6f-6d5237dc6f18 is fetched for user ee2112449b2e4169b0e0901646832ea0. {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 16 17:49:38 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ccb5c506-2059-4895-b6f4-afce7c3e9dbb 1073741824 Sep 16 17:49:38 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:38 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a44d2a15-db29-401c-879f-dad6e2182d6c_gg3mang_ Sep 16 17:49:38 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bc713c-1626-48d8-b2b3-aed0c4949802]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8612c93d-e0df-4252-9c6f-6d5237dc6f18__3bi44v4devstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:39 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8612c93d-e0df-4252-9c6f-6d5237dc6f18__3bi44v4devstack@QuobyteHD Sep 16 17:49:39 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:39 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a44d2a15-db29-401c-879f-dad6e2182d6c_gg3mang_" returned: 1 in 0.362s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a44d2a15-db29-401c-879f-dad6e2182d6c_gg3mang_' failed. Not Retrying. {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c191f5-3d8e-4444-b131-f0ac0cab5eda]: (4, 'raw') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:39 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD Sep 16 17:49:39 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:39 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8612c93d-e0df-4252-9c6f-6d5237dc6f18__3bi44v4devstack@QuobyteHD" returned: 0 in 0.363s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:39 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ccb5c506-2059-4895-b6f4-afce7c3e9dbb 1073741824" returned: 0 in 0.505s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ccb5c506-2059-4895-b6f4-afce7c3e9dbb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:39 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ccb5c506-2059-4895-b6f4-afce7c3e9dbb Sep 16 17:49:39 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:39 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:39 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD Sep 16 17:49:39 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:39 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ccb5c506-2059-4895-b6f4-afce7c3e9dbb" returned: 0 in 0.274s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.365s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-672347908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=167a5d07-ba57-4afe-a015-ff20e0e50328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a179e54eba4492380de8bd88d82c6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:33Z,use_quota=True,user_id='ee2112449b2e4169b0e0901646832ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21dea343-2a60-40e8-aad8-95fd60799047),volume_type_id=21dea343-2a60-40e8-aad8-95fd60799047)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Creating volume 167a5d07-ba57-4afe-a015-ff20e0e50328 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:49:39 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-167a5d07-ba57-4afe-a015-ff20e0e50328 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:39 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-167a5d07-ba57-4afe-a015-ff20e0e50328 1073741824 Sep 16 17:49:39 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee17bff8-fce7-4bc8-b847-4613a5c1ee59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccb5c506-2059-4895-b6f4-afce7c3e9dbb', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b5666b-5b91-4601-99a9-10e8cc7899e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:39 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Volume volume-ccb5c506-2059-4895-b6f4-afce7c3e9dbb (ccb5c506-2059-4895-b6f4-afce7c3e9dbb): created successfully Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b5666b-5b91-4601-99a9-10e8cc7899e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Flow 'volume_create_manager' (2e63b4cb-a32a-473f-8d9e-78c57da06848) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:39 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-2154c24b-cbe3-408b-bd52-0dab810909e4 tempest-VolumesActionsTest-2044150280 None] Created volume successfully. Sep 16 17:49:39 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD' failed. Not Retrying. {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] a44d2a15-db29-401c-879f-dad6e2182d6c was raw, converting to qcow2 {{(pid=85899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 16 17:49:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ebbbf67-2be4-424f-8424-9acd52a86b48 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:40 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ebbbf67-2be4-424f-8424-9acd52a86b48 Sep 16 17:49:40 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:40 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-167a5d07-ba57-4afe-a015-ff20e0e50328 1073741824" returned: 0 in 0.456s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-167a5d07-ba57-4afe-a015-ff20e0e50328 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:40 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-167a5d07-ba57-4afe-a015-ff20e0e50328 Sep 16 17:49:40 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:40 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ebbbf67-2be4-424f-8424-9acd52a86b48" returned: 0 in 0.520s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:40 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a44d2a15-db29-401c-879f-dad6e2182d6c_rmoqz1eedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ebbbf67-2be4-424f-8424-9acd52a86b48 {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:49:40 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Converted 0.00 MB image at 0.00 MB/s Sep 16 17:49:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ebbbf67-2be4-424f-8424-9acd52a86b48 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:40 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ebbbf67-2be4-424f-8424-9acd52a86b48 1G Sep 16 17:49:40 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:40 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-167a5d07-ba57-4afe-a015-ff20e0e50328" returned: 0 in 0.258s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:49:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:40 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Attempting download of 8612c93d-e0df-4252-9c6f-6d5237dc6f18 ((None, [{'url': 'file:///opt/stack/data/glance/images/8612c93d-e0df-4252-9c6f-6d5237dc6f18', 'metadata': {}}])) to volume 167a5d07-ba57-4afe-a015-ff20e0e50328. {{(pid=85899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 17:49:40 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcf2104-7f16-4ecb-b614-a666ed37c574]: (4, 'raw') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:49:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8612c93d-e0df-4252-9c6f-6d5237dc6f18_k4wuh1v2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:40 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8612c93d-e0df-4252-9c6f-6d5237dc6f18_k4wuh1v2 Sep 16 17:49:40 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:40 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ebbbf67-2be4-424f-8424-9acd52a86b48 1G" returned: 0 in 0.358s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:40 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Downloaded image a44d2a15-db29-401c-879f-dad6e2182d6c ((None, [{'url': 'file:///opt/stack/data/glance/images/a44d2a15-db29-401c-879f-dad6e2182d6c', 'metadata': {}}])) to volume 3ebbbf67-2be4-424f-8424-9acd52a86b48 successfully. {{(pid=85899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 17:49:40 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Temporary image a44d2a15-db29-401c-879f-dad6e2182d6c for user 75172fdb3cfe48edac3a9a380a03905d is deleted. {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 16 17:49:40 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Marking volume 3ebbbf67-2be4-424f-8424-9acd52a86b48 as bootable. {{(pid=85899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 17:49:40 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Copying metadata from image a44d2a15-db29-401c-879f-dad6e2182d6c to 3ebbbf67-2be4-424f-8424-9acd52a86b48. {{(pid=85899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 17:49:40 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Creating volume glance metadata for volume 3ebbbf67-2be4-424f-8424-9acd52a86b48 backed by image a44d2a15-db29-401c-879f-dad6e2182d6c with: {'image_id': 'a44d2a15-db29-401c-879f-dad6e2182d6c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9994fc06bd45d377a05c39be89146207', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 17:49:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7daac3d2-e623-4aad-b9c3-cab11296657b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ebbbf67-2be4-424f-8424-9acd52a86b48', 'volume_size': 1, 'image_id': 'a44d2a15-db29-401c-879f-dad6e2182d6c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a44d2a15-db29-401c-879f-dad6e2182d6c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9994fc06bd45d377a05c39be89146207', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6669775540bc4aa4908272dcdd517ed7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7aa85aff035fceb1cdcc1efc1df247f84e267100b2abdeccbe6935016418a66d287923269ea4ffb7108f9655c298317767830f60957b3f8f93007d3151080e63', 'id': 'a44d2a15-db29-401c-879f-dad6e2182d6c', 'created_at': datetime.datetime(2026, 9, 16, 15, 49, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 49, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a44d2a15-db29-401c-879f-dad6e2182d6c/file', 'properties': {}}, 'image_service': }' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6429aa1c-6c2c-4247-90e0-d3ca7e91f98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:40 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Volume volume-3ebbbf67-2be4-424f-8424-9acd52a86b48 (3ebbbf67-2be4-424f-8424-9acd52a86b48): created successfully Sep 16 17:49:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6429aa1c-6c2c-4247-90e0-d3ca7e91f98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Flow 'volume_create_manager' (901e2508-38b8-4b98-8e80-51dea751e7d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:41 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8612c93d-e0df-4252-9c6f-6d5237dc6f18_k4wuh1v2" returned: 0 in 0.379s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8612c93d-e0df-4252-9c6f-6d5237dc6f18_k4wuh1v2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:41 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-7368a146-fa12-4f31-ada2-39198ac4f3e0 tempest-VolumeImageDependencyTests-1967286024 None] Created volume successfully. Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4915f63c-53ea-4398-83ba-b906867cd9ad tempest-VolumesActionsTest-225420878 None] Acquiring lock "cinder-ccb5c506-2059-4895-b6f4-afce7c3e9dbb-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4915f63c-53ea-4398-83ba-b906867cd9ad tempest-VolumesActionsTest-225420878 None] Lock "cinder-ccb5c506-2059-4895-b6f4-afce7c3e9dbb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:41 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8612c93d-e0df-4252-9c6f-6d5237dc6f18_k4wuh1v2 Sep 16 17:49:41 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4915f63c-53ea-4398-83ba-b906867cd9ad tempest-VolumesActionsTest-225420878 None] Acquiring lock "cinder-quobyte-ccb5c506-2059-4895-b6f4-afce7c3e9dbb" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4915f63c-53ea-4398-83ba-b906867cd9ad tempest-VolumesActionsTest-225420878 None] Lock "cinder-quobyte-ccb5c506-2059-4895-b6f4-afce7c3e9dbb" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9141500-9598-4484-82d2-85e00b88e350]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4915f63c-53ea-4398-83ba-b906867cd9ad tempest-VolumesActionsTest-225420878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ccb5c506-2059-4895-b6f4-afce7c3e9dbb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:41 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ccb5c506-2059-4895-b6f4-afce7c3e9dbb Sep 16 17:49:41 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:41 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8612c93d-e0df-4252-9c6f-6d5237dc6f18_k4wuh1v2" returned: 1 in 0.429s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8612c93d-e0df-4252-9c6f-6d5237dc6f18_k4wuh1v2' failed. Not Retrying. {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b8ddd4-1441-4890-a311-a6294233b3a1]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8612c93d-e0df-4252-9c6f-6d5237dc6f18__3bi44v4devstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:41 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8612c93d-e0df-4252-9c6f-6d5237dc6f18__3bi44v4devstack@QuobyteHD Sep 16 17:49:41 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:41 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4915f63c-53ea-4398-83ba-b906867cd9ad tempest-VolumesActionsTest-225420878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ccb5c506-2059-4895-b6f4-afce7c3e9dbb" returned: 0 in 0.408s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4915f63c-53ea-4398-83ba-b906867cd9ad tempest-VolumesActionsTest-225420878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ccb5c506-2059-4895-b6f4-afce7c3e9dbb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:41 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ccb5c506-2059-4895-b6f4-afce7c3e9dbb Sep 16 17:49:41 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:41 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8612c93d-e0df-4252-9c6f-6d5237dc6f18__3bi44v4devstack@QuobyteHD" returned: 0 in 0.390s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] 8612c93d-e0df-4252-9c6f-6d5237dc6f18 was qcow2, converting to qcow2 {{(pid=85899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8612c93d-e0df-4252-9c6f-6d5237dc6f18__3bi44v4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-167a5d07-ba57-4afe-a015-ff20e0e50328 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4ef97d23-e9f4-40ca-a6de-8979e0b114c8 tempest-VolumeImageDependencyTests-1967286024 None] Acquiring lock "cinder-3ebbbf67-2be4-424f-8424-9acd52a86b48-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:41 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8612c93d-e0df-4252-9c6f-6d5237dc6f18__3bi44v4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-167a5d07-ba57-4afe-a015-ff20e0e50328 Sep 16 17:49:41 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4ef97d23-e9f4-40ca-a6de-8979e0b114c8 tempest-VolumeImageDependencyTests-1967286024 None] Lock "cinder-3ebbbf67-2be4-424f-8424-9acd52a86b48-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4ef97d23-e9f4-40ca-a6de-8979e0b114c8 tempest-VolumeImageDependencyTests-1967286024 None] Acquiring lock "cinder-quobyte-3ebbbf67-2be4-424f-8424-9acd52a86b48" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4ef97d23-e9f4-40ca-a6de-8979e0b114c8 tempest-VolumeImageDependencyTests-1967286024 None] Lock "cinder-quobyte-3ebbbf67-2be4-424f-8424-9acd52a86b48" acquired by "delete_volume" :: waited 0.014s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:41 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4915f63c-53ea-4398-83ba-b906867cd9ad tempest-VolumesActionsTest-225420878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ccb5c506-2059-4895-b6f4-afce7c3e9dbb" returned: 0 in 0.303s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf761752-9aba-4175-a70c-244c55942e83]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4ef97d23-e9f4-40ca-a6de-8979e0b114c8 tempest-VolumeImageDependencyTests-1967286024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ebbbf67-2be4-424f-8424-9acd52a86b48 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4915f63c-53ea-4398-83ba-b906867cd9ad tempest-VolumesActionsTest-225420878 None] Lock "cinder-quobyte-ccb5c506-2059-4895-b6f4-afce7c3e9dbb" released by "delete_volume" :: held 0.778s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:49:42 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-4915f63c-53ea-4398-83ba-b906867cd9ad tempest-VolumesActionsTest-225420878 None] Created reservations ['4c38a5a5-77b4-41d7-a08a-28231d15b774', '573e600d-f952-44a3-8e82-d35550f80c18', '8fa7bc26-522c-4c8b-97a6-2053213ea17f', '630957ff-1794-4036-a264-6ae39811a2d2'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:49:42 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ebbbf67-2be4-424f-8424-9acd52a86b48 Sep 16 17:49:42 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4915f63c-53ea-4398-83ba-b906867cd9ad tempest-VolumesActionsTest-225420878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4915f63c-53ea-4398-83ba-b906867cd9ad tempest-VolumesActionsTest-225420878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-4915f63c-53ea-4398-83ba-b906867cd9ad tempest-VolumesActionsTest-225420878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:49:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-4915f63c-53ea-4398-83ba-b906867cd9ad tempest-VolumesActionsTest-225420878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:49:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4915f63c-53ea-4398-83ba-b906867cd9ad tempest-VolumesActionsTest-225420878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4915f63c-53ea-4398-83ba-b906867cd9ad tempest-VolumesActionsTest-225420878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:42 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:49:42 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:42 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4915f63c-53ea-4398-83ba-b906867cd9ad tempest-VolumesActionsTest-225420878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.309s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:42 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-4915f63c-53ea-4398-83ba-b906867cd9ad tempest-VolumesActionsTest-225420878 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:49:42 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4ef97d23-e9f4-40ca-a6de-8979e0b114c8 tempest-VolumeImageDependencyTests-1967286024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ebbbf67-2be4-424f-8424-9acd52a86b48" returned: 0 in 0.464s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4ef97d23-e9f4-40ca-a6de-8979e0b114c8 tempest-VolumeImageDependencyTests-1967286024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ebbbf67-2be4-424f-8424-9acd52a86b48 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:42 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-4915f63c-53ea-4398-83ba-b906867cd9ad tempest-VolumesActionsTest-225420878 None] Deleted volume successfully. Sep 16 17:49:42 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ebbbf67-2be4-424f-8424-9acd52a86b48 Sep 16 17:49:42 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4915f63c-53ea-4398-83ba-b906867cd9ad tempest-VolumesActionsTest-225420878 None] Lock "cinder-ccb5c506-2059-4895-b6f4-afce7c3e9dbb-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:49:42 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4ef97d23-e9f4-40ca-a6de-8979e0b114c8 tempest-VolumeImageDependencyTests-1967286024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3ebbbf67-2be4-424f-8424-9acd52a86b48" returned: 0 in 0.317s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4ef97d23-e9f4-40ca-a6de-8979e0b114c8 tempest-VolumeImageDependencyTests-1967286024 None] Lock "cinder-quobyte-3ebbbf67-2be4-424f-8424-9acd52a86b48" released by "delete_volume" :: held 0.825s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:49:42 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-4ef97d23-e9f4-40ca-a6de-8979e0b114c8 tempest-VolumeImageDependencyTests-1967286024 None] Created reservations ['a220fb58-7dab-47e3-845a-a467ce60314c', '1bb11c8e-418d-43ed-98f5-e1ff35fcc92d', '4f56983b-73b3-4452-851c-60f17678fe95', '7d046a77-5749-4f84-a036-938c2606f4c3'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:49:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4ef97d23-e9f4-40ca-a6de-8979e0b114c8 tempest-VolumeImageDependencyTests-1967286024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4ef97d23-e9f4-40ca-a6de-8979e0b114c8 tempest-VolumeImageDependencyTests-1967286024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-4ef97d23-e9f4-40ca-a6de-8979e0b114c8 tempest-VolumeImageDependencyTests-1967286024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:49:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-4ef97d23-e9f4-40ca-a6de-8979e0b114c8 tempest-VolumeImageDependencyTests-1967286024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:49:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4ef97d23-e9f4-40ca-a6de-8979e0b114c8 tempest-VolumeImageDependencyTests-1967286024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4ef97d23-e9f4-40ca-a6de-8979e0b114c8 tempest-VolumeImageDependencyTests-1967286024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:42 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:49:43 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:49:43 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Flow 'volume_create_manager' (f591b5bb-44b5-4314-9ea7-760a24d35be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35460ce9-c188-4766-8420-9f06e0a95437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35460ce9-c188-4766-8420-9f06e0a95437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1847783277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8c40f0-cc99-4da2-98e3-28a3e3e9931a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4479bad5abd849aab909bf2fcbd15733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:43Z,use_quota=True,user_id='1e32776d54b74e81bd75611b7ec6c399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354f8b58-5435-4efb-9375-4194275034e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354f8b58-5435-4efb-9375-4194275034e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (459a82de-fe91-492d-aa44-c9f0e97690c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (459a82de-fe91-492d-aa44-c9f0e97690c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b8c40f0-cc99-4da2-98e3-28a3e3e9931a', 'volume_name': 'volume-3b8c40f0-cc99-4da2-98e3-28a3e3e9931a', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686cc892-5ada-4a7b-8e50-e673ed3505de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686cc892-5ada-4a7b-8e50-e673ed3505de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012f65a3-e896-4420-bc53-26068e2954a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:43 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Volume 3b8c40f0-cc99-4da2-98e3-28a3e3e9931a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b8c40f0-cc99-4da2-98e3-28a3e3e9931a', 'volume_size': 1} Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1847783277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8c40f0-cc99-4da2-98e3-28a3e3e9931a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4479bad5abd849aab909bf2fcbd15733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:43Z,use_quota=True,user_id='1e32776d54b74e81bd75611b7ec6c399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Creating volume 3b8c40f0-cc99-4da2-98e3-28a3e3e9931a {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:49:43 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3b8c40f0-cc99-4da2-98e3-28a3e3e9931a 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:43 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3b8c40f0-cc99-4da2-98e3-28a3e3e9931a 1073741824 Sep 16 17:49:43 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:43 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4ef97d23-e9f4-40ca-a6de-8979e0b114c8 tempest-VolumeImageDependencyTests-1967286024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.352s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-4ef97d23-e9f4-40ca-a6de-8979e0b114c8 tempest-VolumeImageDependencyTests-1967286024 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:49:43 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-4ef97d23-e9f4-40ca-a6de-8979e0b114c8 tempest-VolumeImageDependencyTests-1967286024 None] Deleted volume successfully. Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4ef97d23-e9f4-40ca-a6de-8979e0b114c8 tempest-VolumeImageDependencyTests-1967286024 None] Lock "cinder-3ebbbf67-2be4-424f-8424-9acd52a86b48-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:49:43 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3b8c40f0-cc99-4da2-98e3-28a3e3e9931a 1073741824" returned: 0 in 0.585s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3b8c40f0-cc99-4da2-98e3-28a3e3e9931a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:43 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3b8c40f0-cc99-4da2-98e3-28a3e3e9931a Sep 16 17:49:43 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:44 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3b8c40f0-cc99-4da2-98e3-28a3e3e9931a" returned: 0 in 0.346s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:49:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012f65a3-e896-4420-bc53-26068e2954a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b8c40f0-cc99-4da2-98e3-28a3e3e9931a', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (033e7100-5658-415b-a4ef-60ea1fa3fe02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:44 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Volume volume-3b8c40f0-cc99-4da2-98e3-28a3e3e9931a (3b8c40f0-cc99-4da2-98e3-28a3e3e9931a): created successfully Sep 16 17:49:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (033e7100-5658-415b-a4ef-60ea1fa3fe02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Flow 'volume_create_manager' (f591b5bb-44b5-4314-9ea7-760a24d35be2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:44 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-37eefaf7-617c-4298-8968-8cb97f9689a2 tempest-VolumesActionsTest-2044150280 None] Created volume successfully. Sep 16 17:49:44 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8612c93d-e0df-4252-9c6f-6d5237dc6f18__3bi44v4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-167a5d07-ba57-4afe-a015-ff20e0e50328" returned: 0 in 2.399s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:44 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8612c93d-e0df-4252-9c6f-6d5237dc6f18__3bi44v4devstack@QuobyteHD, size 112.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-167a5d07-ba57-4afe-a015-ff20e0e50328 {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:49:44 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Converted 112.00 MB image at 46.65 MB/s Sep 16 17:49:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-167a5d07-ba57-4afe-a015-ff20e0e50328 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:44 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-167a5d07-ba57-4afe-a015-ff20e0e50328 1G Sep 16 17:49:44 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:44 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-167a5d07-ba57-4afe-a015-ff20e0e50328 1G" returned: 0 in 0.340s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:44 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Downloaded image 8612c93d-e0df-4252-9c6f-6d5237dc6f18 ((None, [{'url': 'file:///opt/stack/data/glance/images/8612c93d-e0df-4252-9c6f-6d5237dc6f18', 'metadata': {}}])) to volume 167a5d07-ba57-4afe-a015-ff20e0e50328 successfully. {{(pid=85899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 17:49:44 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Temporary image 8612c93d-e0df-4252-9c6f-6d5237dc6f18 for user ee2112449b2e4169b0e0901646832ea0 is deleted. {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 16 17:49:44 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Marking volume 167a5d07-ba57-4afe-a015-ff20e0e50328 as bootable. {{(pid=85899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 17:49:44 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Copying metadata from image 8612c93d-e0df-4252-9c6f-6d5237dc6f18 to 167a5d07-ba57-4afe-a015-ff20e0e50328. {{(pid=85899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 17:49:44 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Creating volume glance metadata for volume 167a5d07-ba57-4afe-a015-ff20e0e50328 backed by image 8612c93d-e0df-4252-9c6f-6d5237dc6f18 with: {'image_id': '8612c93d-e0df-4252-9c6f-6d5237dc6f18', 'image_name': 'tempest-scenario-img--1429503775', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 17:49:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f48948-b3bc-4d47-8df5-3d76b89360c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-167a5d07-ba57-4afe-a015-ff20e0e50328', 'volume_size': 1, 'image_id': '8612c93d-e0df-4252-9c6f-6d5237dc6f18', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8612c93d-e0df-4252-9c6f-6d5237dc6f18', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1429503775', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8a179e54eba4492380de8bd88d82c6e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8612c93d-e0df-4252-9c6f-6d5237dc6f18', 'created_at': datetime.datetime(2026, 9, 16, 15, 49, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 49, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8612c93d-e0df-4252-9c6f-6d5237dc6f18/file', 'properties': {}}, 'image_service': }' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1d429a8-452f-4cb0-b848-928ba0526db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:44 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Volume volume-167a5d07-ba57-4afe-a015-ff20e0e50328 (167a5d07-ba57-4afe-a015-ff20e0e50328): created successfully Sep 16 17:49:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1d429a8-452f-4cb0-b848-928ba0526db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Flow 'volume_create_manager' (df8e1004-9c13-4952-b5bb-40444b73cf23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:44 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-814ad278-9633-4f26-b250-8f4013521422 tempest-TestInstancesWithCinderVolumes-991321737 None] Created volume successfully. Sep 16 17:49:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-92e8aee0-9a1a-40c2-869f-27c59cd2fb27 tempest-VolumesActionsTest-225420878 None] Acquiring lock "cinder-3b8c40f0-cc99-4da2-98e3-28a3e3e9931a-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-92e8aee0-9a1a-40c2-869f-27c59cd2fb27 tempest-VolumesActionsTest-225420878 None] Lock "cinder-3b8c40f0-cc99-4da2-98e3-28a3e3e9931a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-92e8aee0-9a1a-40c2-869f-27c59cd2fb27 tempest-VolumesActionsTest-225420878 None] Acquiring lock "cinder-quobyte-3b8c40f0-cc99-4da2-98e3-28a3e3e9931a" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-92e8aee0-9a1a-40c2-869f-27c59cd2fb27 tempest-VolumesActionsTest-225420878 None] Lock "cinder-quobyte-3b8c40f0-cc99-4da2-98e3-28a3e3e9931a" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:45 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd19b0f-ecd7-44d8-93e0-3918e105284f]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:49:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-92e8aee0-9a1a-40c2-869f-27c59cd2fb27 tempest-VolumesActionsTest-225420878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3b8c40f0-cc99-4da2-98e3-28a3e3e9931a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:45 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3b8c40f0-cc99-4da2-98e3-28a3e3e9931a Sep 16 17:49:45 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:45 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-92e8aee0-9a1a-40c2-869f-27c59cd2fb27 tempest-VolumesActionsTest-225420878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3b8c40f0-cc99-4da2-98e3-28a3e3e9931a" returned: 0 in 0.448s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-92e8aee0-9a1a-40c2-869f-27c59cd2fb27 tempest-VolumesActionsTest-225420878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3b8c40f0-cc99-4da2-98e3-28a3e3e9931a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:45 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3b8c40f0-cc99-4da2-98e3-28a3e3e9931a Sep 16 17:49:45 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:46 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-92e8aee0-9a1a-40c2-869f-27c59cd2fb27 tempest-VolumesActionsTest-225420878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3b8c40f0-cc99-4da2-98e3-28a3e3e9931a" returned: 0 in 0.293s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-92e8aee0-9a1a-40c2-869f-27c59cd2fb27 tempest-VolumesActionsTest-225420878 None] Lock "cinder-quobyte-3b8c40f0-cc99-4da2-98e3-28a3e3e9931a" released by "delete_volume" :: held 0.803s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-92e8aee0-9a1a-40c2-869f-27c59cd2fb27 tempest-VolumesActionsTest-225420878 None] Created reservations ['d3a0bc2d-5950-4d89-98ab-07ac3244e6c6', 'a2dcde7b-de0f-4311-865a-47d016531f6f', 'fabdea1c-625e-4555-b1b7-447c2da77791', 'b6fcc719-52e9-4208-842d-addc2c577065'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-92e8aee0-9a1a-40c2-869f-27c59cd2fb27 tempest-VolumesActionsTest-225420878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-92e8aee0-9a1a-40c2-869f-27c59cd2fb27 tempest-VolumesActionsTest-225420878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-92e8aee0-9a1a-40c2-869f-27c59cd2fb27 tempest-VolumesActionsTest-225420878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-92e8aee0-9a1a-40c2-869f-27c59cd2fb27 tempest-VolumesActionsTest-225420878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-92e8aee0-9a1a-40c2-869f-27c59cd2fb27 tempest-VolumesActionsTest-225420878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-92e8aee0-9a1a-40c2-869f-27c59cd2fb27 tempest-VolumesActionsTest-225420878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:46 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:49:46 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:46 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-92e8aee0-9a1a-40c2-869f-27c59cd2fb27 tempest-VolumesActionsTest-225420878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.414s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-92e8aee0-9a1a-40c2-869f-27c59cd2fb27 tempest-VolumesActionsTest-225420878 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:49:46 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-92e8aee0-9a1a-40c2-869f-27c59cd2fb27 tempest-VolumesActionsTest-225420878 None] Deleted volume successfully. Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-92e8aee0-9a1a-40c2-869f-27c59cd2fb27 tempest-VolumesActionsTest-225420878 None] Lock "cinder-3b8c40f0-cc99-4da2-98e3-28a3e3e9931a-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Flow 'volume_create_manager' (0b9ae57f-113d-40b4-91e3-62fc93bf619a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6cb828-625f-483f-b2ea-760b9c6c14a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6cb828-625f-483f-b2ea-760b9c6c14a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5726717f-dc39-47cb-82bf-38aa3285eaf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adedd8d546f14101a434f048f1c764e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:47Z,use_quota=True,user_id='60d0d7d63f7b4618a1b0c9ed47d87cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61907a5c-529b-4b9f-b9bc-20dfc3fb8296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61907a5c-529b-4b9f-b9bc-20dfc3fb8296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d369ae07-1743-47e7-9f32-da783843c8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d369ae07-1743-47e7-9f32-da783843c8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5726717f-dc39-47cb-82bf-38aa3285eaf8', 'volume_name': 'volume-5726717f-dc39-47cb-82bf-38aa3285eaf8', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4649f3-0951-4e3e-bcce-af03d3b853c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4649f3-0951-4e3e-bcce-af03d3b853c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a1d8605-0162-41fc-8806-e1125dac20c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:46 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Volume 5726717f-dc39-47cb-82bf-38aa3285eaf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5726717f-dc39-47cb-82bf-38aa3285eaf8', 'volume_size': 1} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5726717f-dc39-47cb-82bf-38aa3285eaf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adedd8d546f14101a434f048f1c764e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:47Z,use_quota=True,user_id='60d0d7d63f7b4618a1b0c9ed47d87cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Creating volume 5726717f-dc39-47cb-82bf-38aa3285eaf8 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:49:46 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:49:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5726717f-dc39-47cb-82bf-38aa3285eaf8 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:46 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5726717f-dc39-47cb-82bf-38aa3285eaf8 1073741824 Sep 16 17:49:46 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Flow 'volume_create_manager' (773fe778-11e8-44e0-9ac9-83e1f943c15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065ae169-12b9-4ba1-9aed-e310a6dfc411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065ae169-12b9-4ba1-9aed-e310a6dfc411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1423618819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24cc70f-5be2-4143-8e2c-b4372d941d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4479bad5abd849aab909bf2fcbd15733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:47Z,use_quota=True,user_id='1e32776d54b74e81bd75611b7ec6c399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dc38479-3540-45b9-9fa6-296762587aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dc38479-3540-45b9-9fa6-296762587aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26b8317-d861-468c-864a-3e09295a2076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26b8317-d861-468c-864a-3e09295a2076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd24cc70f-5be2-4143-8e2c-b4372d941d03', 'volume_name': 'volume-d24cc70f-5be2-4143-8e2c-b4372d941d03', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b959052d-75a4-4d23-b007-042285a2fbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b959052d-75a4-4d23-b007-042285a2fbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89230092-fa7d-4943-b142-feff9dd33390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:47 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Volume d24cc70f-5be2-4143-8e2c-b4372d941d03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d24cc70f-5be2-4143-8e2c-b4372d941d03', 'volume_size': 1} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:47 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5726717f-dc39-47cb-82bf-38aa3285eaf8 1073741824" returned: 0 in 0.535s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5726717f-dc39-47cb-82bf-38aa3285eaf8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:47 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5726717f-dc39-47cb-82bf-38aa3285eaf8 Sep 16 17:49:47 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:47 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5726717f-dc39-47cb-82bf-38aa3285eaf8" returned: 0 in 0.299s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.613s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1423618819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24cc70f-5be2-4143-8e2c-b4372d941d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4479bad5abd849aab909bf2fcbd15733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:47Z,use_quota=True,user_id='1e32776d54b74e81bd75611b7ec6c399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Creating volume d24cc70f-5be2-4143-8e2c-b4372d941d03 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:49:47 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d24cc70f-5be2-4143-8e2c-b4372d941d03 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a1d8605-0162-41fc-8806-e1125dac20c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5726717f-dc39-47cb-82bf-38aa3285eaf8', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:47 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d24cc70f-5be2-4143-8e2c-b4372d941d03 1073741824 Sep 16 17:49:47 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab33fca-ef7c-4eb1-8559-74c671bffee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:47 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Volume volume-5726717f-dc39-47cb-82bf-38aa3285eaf8 (5726717f-dc39-47cb-82bf-38aa3285eaf8): created successfully Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab33fca-ef7c-4eb1-8559-74c671bffee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Flow 'volume_create_manager' (0b9ae57f-113d-40b4-91e3-62fc93bf619a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:47 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-284fd6ad-e70f-414b-a8c0-31a54aed2539 tempest-CinderUnicodeTest-2129017985 None] Created volume successfully. Sep 16 17:49:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-24c394de-781c-4f1f-bd9a-a52327e422cc req-15cf6542-c95c-4063-bcf3-cd9ebbb9a86d tempest-TestInstancesWithCinderVolumes-991321737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:48 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d24cc70f-5be2-4143-8e2c-b4372d941d03 1073741824" returned: 0 in 0.513s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d24cc70f-5be2-4143-8e2c-b4372d941d03 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:48 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d24cc70f-5be2-4143-8e2c-b4372d941d03 Sep 16 17:49:48 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:48 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d24cc70f-5be2-4143-8e2c-b4372d941d03" returned: 0 in 0.264s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:49:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-24c394de-781c-4f1f-bd9a-a52327e422cc req-15cf6542-c95c-4063-bcf3-cd9ebbb9a86d tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.667s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-24c394de-781c-4f1f-bd9a-a52327e422cc req-15cf6542-c95c-4063-bcf3-cd9ebbb9a86d tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89230092-fa7d-4943-b142-feff9dd33390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d24cc70f-5be2-4143-8e2c-b4372d941d03', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61ff541-517b-460c-b1ab-56c139753067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:48 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Volume volume-d24cc70f-5be2-4143-8e2c-b4372d941d03 (d24cc70f-5be2-4143-8e2c-b4372d941d03): created successfully Sep 16 17:49:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61ff541-517b-460c-b1ab-56c139753067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Flow 'volume_create_manager' (773fe778-11e8-44e0-9ac9-83e1f943c15a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:48 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-8aff527c-cd3e-4bc5-9724-3ca8f3463e65 tempest-VolumesActionsTest-2044150280 None] Created volume successfully. Sep 16 17:49:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-24c394de-781c-4f1f-bd9a-a52327e422cc req-15cf6542-c95c-4063-bcf3-cd9ebbb9a86d tempest-TestInstancesWithCinderVolumes-991321737 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7', 'name': 'volume-167a5d07-ba57-4afe-a015-ff20e0e50328', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4c80e45-415e-4c66-83ed-ea0cd6962a63', 'enforce_multipath': True} {{(pid=85899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4920}} Sep 16 17:49:48 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-24c394de-781c-4f1f-bd9a-a52327e422cc req-15cf6542-c95c-4063-bcf3-cd9ebbb9a86d tempest-TestInstancesWithCinderVolumes-991321737 None] attachment_update completed successfully. Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Flow 'volume_create_manager' (f68d41fd-71f5-47b3-bfae-96e2406173c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74965d39-7336-4d58-8512-1b76e4e1970c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74965d39-7336-4d58-8512-1b76e4e1970c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1788525103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ca7753-992c-4858-9e05-cd7a2bdea2e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adedd8d546f14101a434f048f1c764e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:49Z,use_quota=True,user_id='60d0d7d63f7b4618a1b0c9ed47d87cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e2bef5-8564-49df-a7a6-2d0f0a5339d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e2bef5-8564-49df-a7a6-2d0f0a5339d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56597ff-5620-457b-a5f4-97271317c5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56597ff-5620-457b-a5f4-97271317c5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ca7753-992c-4858-9e05-cd7a2bdea2e8', 'volume_name': 'volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda45174-1e95-48e4-83ce-1e22c44a525c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda45174-1e95-48e4-83ce-1e22c44a525c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e6c774-82bc-466e-8567-2e7a3124942f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:49 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Volume 41ca7753-992c-4858-9e05-cd7a2bdea2e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8', 'volume_size': 1} Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:49:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1788525103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ca7753-992c-4858-9e05-cd7a2bdea2e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adedd8d546f14101a434f048f1c764e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:49:49Z,use_quota=True,user_id='60d0d7d63f7b4618a1b0c9ed47d87cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Creating volume 41ca7753-992c-4858-9e05-cd7a2bdea2e8 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:49:49 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:49 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8 1073741824 Sep 16 17:49:49 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-31659869-cc38-4353-a6d0-a29af25931dd tempest-VolumesActionsTest-2044150280 None] Acquiring lock "cinder-d24cc70f-5be2-4143-8e2c-b4372d941d03-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:49 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-31659869-cc38-4353-a6d0-a29af25931dd tempest-VolumesActionsTest-2044150280 None] Lock "cinder-d24cc70f-5be2-4143-8e2c-b4372d941d03-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-31659869-cc38-4353-a6d0-a29af25931dd tempest-VolumesActionsTest-2044150280 None] Acquiring lock "cinder-quobyte-d24cc70f-5be2-4143-8e2c-b4372d941d03" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-31659869-cc38-4353-a6d0-a29af25931dd tempest-VolumesActionsTest-2044150280 None] Lock "cinder-quobyte-d24cc70f-5be2-4143-8e2c-b4372d941d03" acquired by "delete_volume" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:50 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b56da6-860d-489f-a903-38cdc924e4ea]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:49:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-31659869-cc38-4353-a6d0-a29af25931dd tempest-VolumesActionsTest-2044150280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d24cc70f-5be2-4143-8e2c-b4372d941d03 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:50 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8 1073741824" returned: 0 in 0.535s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:50 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d24cc70f-5be2-4143-8e2c-b4372d941d03 Sep 16 17:49:50 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:50 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8 Sep 16 17:49:50 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:50 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:50 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8" returned: 0 in 0.304s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:50 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:49:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-31659869-cc38-4353-a6d0-a29af25931dd tempest-VolumesActionsTest-2044150280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d24cc70f-5be2-4143-8e2c-b4372d941d03" returned: 0 in 0.424s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-31659869-cc38-4353-a6d0-a29af25931dd tempest-VolumesActionsTest-2044150280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d24cc70f-5be2-4143-8e2c-b4372d941d03 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:50 devstack sudo[99349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d24cc70f-5be2-4143-8e2c-b4372d941d03 Sep 16 17:49:50 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e6c774-82bc-466e-8567-2e7a3124942f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e27476-1255-4d08-af9e-f1ff2cd35f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:49:50 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Volume volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8 (41ca7753-992c-4858-9e05-cd7a2bdea2e8): created successfully Sep 16 17:49:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e27476-1255-4d08-af9e-f1ff2cd35f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:49:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Flow 'volume_create_manager' (f68d41fd-71f5-47b3-bfae-96e2406173c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:49:50 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-9f1523c3-d602-4761-9d31-362edb34d3ef tempest-CinderUnicodeTest-2129017985 None] Created volume successfully. Sep 16 17:49:50 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-31659869-cc38-4353-a6d0-a29af25931dd tempest-VolumesActionsTest-2044150280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d24cc70f-5be2-4143-8e2c-b4372d941d03" returned: 0 in 0.338s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-31659869-cc38-4353-a6d0-a29af25931dd tempest-VolumesActionsTest-2044150280 None] Lock "cinder-quobyte-d24cc70f-5be2-4143-8e2c-b4372d941d03" released by "delete_volume" :: held 0.822s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:49:51 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-31659869-cc38-4353-a6d0-a29af25931dd tempest-VolumesActionsTest-2044150280 None] Created reservations ['cc483699-447f-4b0a-863e-8d98f73f6314', '4184ebcb-6a6f-4706-bb84-18a8ea208b65', '2e43075b-364f-4ac0-8b4a-fd81b9dffa6d', '6dcdbdee-827c-4f3b-827b-dce4c8e85e39'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:49:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-31659869-cc38-4353-a6d0-a29af25931dd tempest-VolumesActionsTest-2044150280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-31659869-cc38-4353-a6d0-a29af25931dd tempest-VolumesActionsTest-2044150280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-31659869-cc38-4353-a6d0-a29af25931dd tempest-VolumesActionsTest-2044150280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:49:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-31659869-cc38-4353-a6d0-a29af25931dd tempest-VolumesActionsTest-2044150280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:49:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-31659869-cc38-4353-a6d0-a29af25931dd tempest-VolumesActionsTest-2044150280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-31659869-cc38-4353-a6d0-a29af25931dd tempest-VolumesActionsTest-2044150280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:51 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:49:51 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:51 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-31659869-cc38-4353-a6d0-a29af25931dd tempest-VolumesActionsTest-2044150280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.590s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:51 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-31659869-cc38-4353-a6d0-a29af25931dd tempest-VolumesActionsTest-2044150280 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:49:51 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-31659869-cc38-4353-a6d0-a29af25931dd tempest-VolumesActionsTest-2044150280 None] Deleted volume successfully. Sep 16 17:49:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-31659869-cc38-4353-a6d0-a29af25931dd tempest-VolumesActionsTest-2044150280 None] Lock "cinder-d24cc70f-5be2-4143-8e2c-b4372d941d03-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:49:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-dad8aeb6-daa1-4197-b914-817f321d47bb tempest-CinderUnicodeTest-2129017985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:49:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-dad8aeb6-daa1-4197-b914-817f321d47bb tempest-CinderUnicodeTest-2129017985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:49:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-dad8aeb6-daa1-4197-b914-817f321d47bb tempest-CinderUnicodeTest-2129017985 None] Creating offline snapshot 4381586c-4414-43e1-aa93-2bace8d303a6 of volume 41ca7753-992c-4858-9e05-cd7a2bdea2e8 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:49:52 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faa7c92-c1e5-4ad9-b76b-2acb141c6c4e]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:49:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dad8aeb6-daa1-4197-b914-817f321d47bb tempest-CinderUnicodeTest-2129017985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:52 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8 Sep 16 17:49:52 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:52 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dad8aeb6-daa1-4197-b914-817f321d47bb tempest-CinderUnicodeTest-2129017985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8" returned: 0 in 0.440s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dad8aeb6-daa1-4197-b914-817f321d47bb tempest-CinderUnicodeTest-2129017985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.4381586c-4414-43e1-aa93-2bace8d303a6 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:52 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.4381586c-4414-43e1-aa93-2bace8d303a6 1G Sep 16 17:49:52 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:53 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dad8aeb6-daa1-4197-b914-817f321d47bb tempest-CinderUnicodeTest-2129017985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.4381586c-4414-43e1-aa93-2bace8d303a6 1G" returned: 0 in 0.762s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dad8aeb6-daa1-4197-b914-817f321d47bb tempest-CinderUnicodeTest-2129017985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.4381586c-4414-43e1-aa93-2bace8d303a6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:53 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.4381586c-4414-43e1-aa93-2bace8d303a6 Sep 16 17:49:53 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:53 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dad8aeb6-daa1-4197-b914-817f321d47bb tempest-CinderUnicodeTest-2129017985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.4381586c-4414-43e1-aa93-2bace8d303a6" returned: 0 in 0.344s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:53 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-dad8aeb6-daa1-4197-b914-817f321d47bb tempest-CinderUnicodeTest-2129017985 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.4381586c-4414-43e1-aa93-2bace8d303a6 is being set with open permissions: ugo+rw Sep 16 17:49:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dad8aeb6-daa1-4197-b914-817f321d47bb tempest-CinderUnicodeTest-2129017985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.4381586c-4414-43e1-aa93-2bace8d303a6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:53 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.4381586c-4414-43e1-aa93-2bace8d303a6 Sep 16 17:49:53 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:53 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dad8aeb6-daa1-4197-b914-817f321d47bb tempest-CinderUnicodeTest-2129017985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.4381586c-4414-43e1-aa93-2bace8d303a6" returned: 0 in 0.258s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dad8aeb6-daa1-4197-b914-817f321d47bb tempest-CinderUnicodeTest-2129017985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:54 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.info Sep 16 17:49:54 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:54 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dad8aeb6-daa1-4197-b914-817f321d47bb tempest-CinderUnicodeTest-2129017985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.info" returned: 0 in 0.380s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:54 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-dad8aeb6-daa1-4197-b914-817f321d47bb tempest-CinderUnicodeTest-2129017985 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.info is being set with open permissions: ugo+rw Sep 16 17:49:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dad8aeb6-daa1-4197-b914-817f321d47bb tempest-CinderUnicodeTest-2129017985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:54 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.info Sep 16 17:49:54 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:54 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dad8aeb6-daa1-4197-b914-817f321d47bb tempest-CinderUnicodeTest-2129017985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.info" returned: 0 in 0.366s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-dad8aeb6-daa1-4197-b914-817f321d47bb tempest-CinderUnicodeTest-2129017985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.674s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:49:54 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-dad8aeb6-daa1-4197-b914-817f321d47bb tempest-CinderUnicodeTest-2129017985 None] Create snapshot completed successfully Sep 16 17:49:55 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3300cf79-2145-4ece-9534-44920922a42e tempest-CinderUnicodeTest-2129017985 None] Acquiring lock "cinder-4381586c-4414-43e1-aa93-2bace8d303a6-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:55 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3300cf79-2145-4ece-9534-44920922a42e tempest-CinderUnicodeTest-2129017985 None] Lock "cinder-4381586c-4414-43e1-aa93-2bace8d303a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:55 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3300cf79-2145-4ece-9534-44920922a42e tempest-CinderUnicodeTest-2129017985 None] Acquiring lock "cinder-quobyte-41ca7753-992c-4858-9e05-cd7a2bdea2e8" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:55 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3300cf79-2145-4ece-9534-44920922a42e tempest-CinderUnicodeTest-2129017985 None] Lock "cinder-quobyte-41ca7753-992c-4858-9e05-cd7a2bdea2e8" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:55 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3300cf79-2145-4ece-9534-44920922a42e tempest-CinderUnicodeTest-2129017985 None] Acquiring lock "cinder-quobyte-4381586c-4414-43e1-aa93-2bace8d303a6" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:55 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3300cf79-2145-4ece-9534-44920922a42e tempest-CinderUnicodeTest-2129017985 None] Lock "cinder-quobyte-4381586c-4414-43e1-aa93-2bace8d303a6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:55 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-3300cf79-2145-4ece-9534-44920922a42e tempest-CinderUnicodeTest-2129017985 None] Deleting offline snapshot 4381586c-4414-43e1-aa93-2bace8d303a6 of volume 41ca7753-992c-4858-9e05-cd7a2bdea2e8 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:49:55 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-3300cf79-2145-4ece-9534-44920922a42e tempest-CinderUnicodeTest-2129017985 None] snapshot_file for this snap is: volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.4381586c-4414-43e1-aa93-2bace8d303a6 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:49:55 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc26a9a3-b8b5-464f-b74a-59b5a274ef97]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:49:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3300cf79-2145-4ece-9534-44920922a42e tempest-CinderUnicodeTest-2129017985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.4381586c-4414-43e1-aa93-2bace8d303a6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:55 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.4381586c-4414-43e1-aa93-2bace8d303a6 Sep 16 17:49:55 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:56 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3300cf79-2145-4ece-9534-44920922a42e tempest-CinderUnicodeTest-2129017985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.4381586c-4414-43e1-aa93-2bace8d303a6" returned: 0 in 0.565s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:56 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-3300cf79-2145-4ece-9534-44920922a42e tempest-CinderUnicodeTest-2129017985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:49:56 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc1a807-bad7-4148-acfe-afcb7fd044dc]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:49:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3300cf79-2145-4ece-9534-44920922a42e tempest-CinderUnicodeTest-2129017985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:56 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8 Sep 16 17:49:56 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:56 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3300cf79-2145-4ece-9534-44920922a42e tempest-CinderUnicodeTest-2129017985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8" returned: 0 in 0.500s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3300cf79-2145-4ece-9534-44920922a42e tempest-CinderUnicodeTest-2129017985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.4381586c-4414-43e1-aa93-2bace8d303a6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:56 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.4381586c-4414-43e1-aa93-2bace8d303a6 Sep 16 17:49:56 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:57 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3300cf79-2145-4ece-9534-44920922a42e tempest-CinderUnicodeTest-2129017985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.4381586c-4414-43e1-aa93-2bace8d303a6" returned: 0 in 0.687s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3300cf79-2145-4ece-9534-44920922a42e tempest-CinderUnicodeTest-2129017985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.4381586c-4414-43e1-aa93-2bace8d303a6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:57 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.4381586c-4414-43e1-aa93-2bace8d303a6 Sep 16 17:49:57 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:57 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3300cf79-2145-4ece-9534-44920922a42e tempest-CinderUnicodeTest-2129017985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8.4381586c-4414-43e1-aa93-2bace8d303a6" returned: 0 in 0.583s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3300cf79-2145-4ece-9534-44920922a42e tempest-CinderUnicodeTest-2129017985 None] Lock "cinder-quobyte-4381586c-4414-43e1-aa93-2bace8d303a6" released by "_delete_snapshot" :: held 2.519s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:49:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3300cf79-2145-4ece-9534-44920922a42e tempest-CinderUnicodeTest-2129017985 None] Lock "cinder-quobyte-41ca7753-992c-4858-9e05-cd7a2bdea2e8" released by "delete_snapshot" :: held 2.574s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:49:58 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-3300cf79-2145-4ece-9534-44920922a42e tempest-CinderUnicodeTest-2129017985 None] Created reservations ['dbcc3457-2f34-46a2-8379-45444d80bc94', '0b770730-d36c-4b8a-9cc0-3f0be5892265', 'e871e51b-b40f-4a39-aaef-d8590a21ca95', 'f4a6412c-68dc-40ba-aa46-910745ad30ae'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:49:58 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-3300cf79-2145-4ece-9534-44920922a42e tempest-CinderUnicodeTest-2129017985 None] Delete snapshot completed successfully. Sep 16 17:49:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3300cf79-2145-4ece-9534-44920922a42e tempest-CinderUnicodeTest-2129017985 None] Lock "cinder-4381586c-4414-43e1-aa93-2bace8d303a6-delete_snapshot" released by "delete_snapshot" :: held 2.877s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:49:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fb700460-2a29-4fa5-ae2a-324b24eef9e5 tempest-CinderUnicodeTest-2129017985 None] Acquiring lock "cinder-41ca7753-992c-4858-9e05-cd7a2bdea2e8-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fb700460-2a29-4fa5-ae2a-324b24eef9e5 tempest-CinderUnicodeTest-2129017985 None] Lock "cinder-41ca7753-992c-4858-9e05-cd7a2bdea2e8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fb700460-2a29-4fa5-ae2a-324b24eef9e5 tempest-CinderUnicodeTest-2129017985 None] Acquiring lock "cinder-quobyte-41ca7753-992c-4858-9e05-cd7a2bdea2e8" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:49:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fb700460-2a29-4fa5-ae2a-324b24eef9e5 tempest-CinderUnicodeTest-2129017985 None] Lock "cinder-quobyte-41ca7753-992c-4858-9e05-cd7a2bdea2e8" acquired by "delete_volume" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:49:59 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe9531c-2efa-44ab-84e8-bfa875437590]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:49:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fb700460-2a29-4fa5-ae2a-324b24eef9e5 tempest-CinderUnicodeTest-2129017985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:59 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8 Sep 16 17:49:59 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:59 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fb700460-2a29-4fa5-ae2a-324b24eef9e5 tempest-CinderUnicodeTest-2129017985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8" returned: 0 in 0.531s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fb700460-2a29-4fa5-ae2a-324b24eef9e5 tempest-CinderUnicodeTest-2129017985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:49:59 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8 Sep 16 17:49:59 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:49:59 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Sep 16 17:49:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fb700460-2a29-4fa5-ae2a-324b24eef9e5 tempest-CinderUnicodeTest-2129017985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41ca7753-992c-4858-9e05-cd7a2bdea2e8" returned: 0 in 0.348s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:49:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fb700460-2a29-4fa5-ae2a-324b24eef9e5 tempest-CinderUnicodeTest-2129017985 None] Lock "cinder-quobyte-41ca7753-992c-4858-9e05-cd7a2bdea2e8" released by "delete_volume" :: held 0.978s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:49:59 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-fb700460-2a29-4fa5-ae2a-324b24eef9e5 tempest-CinderUnicodeTest-2129017985 None] Created reservations ['7735278a-645b-4c12-bf76-16e1b8aaa5ee', '2289da10-8211-478f-ab89-135f4a98bc82', '93a072aa-9623-4a6d-9ab2-b3fe851da031', 'eb02418d-f8b2-43d3-84ed-b1f155f01895'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:50:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fb700460-2a29-4fa5-ae2a-324b24eef9e5 tempest-CinderUnicodeTest-2129017985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fb700460-2a29-4fa5-ae2a-324b24eef9e5 tempest-CinderUnicodeTest-2129017985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fb700460-2a29-4fa5-ae2a-324b24eef9e5 tempest-CinderUnicodeTest-2129017985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fb700460-2a29-4fa5-ae2a-324b24eef9e5 tempest-CinderUnicodeTest-2129017985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fb700460-2a29-4fa5-ae2a-324b24eef9e5 tempest-CinderUnicodeTest-2129017985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fb700460-2a29-4fa5-ae2a-324b24eef9e5 tempest-CinderUnicodeTest-2129017985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:00 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:50:00 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:00 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fb700460-2a29-4fa5-ae2a-324b24eef9e5 tempest-CinderUnicodeTest-2129017985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.312s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:00 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-fb700460-2a29-4fa5-ae2a-324b24eef9e5 tempest-CinderUnicodeTest-2129017985 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:50:00 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-fb700460-2a29-4fa5-ae2a-324b24eef9e5 tempest-CinderUnicodeTest-2129017985 None] Deleted volume successfully. Sep 16 17:50:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fb700460-2a29-4fa5-ae2a-324b24eef9e5 tempest-CinderUnicodeTest-2129017985 None] Lock "cinder-41ca7753-992c-4858-9e05-cd7a2bdea2e8-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bce81514-fdfa-4084-90ac-5e0f35ee2239 tempest-CinderUnicodeTest-2129017985 None] Acquiring lock "cinder-5726717f-dc39-47cb-82bf-38aa3285eaf8-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bce81514-fdfa-4084-90ac-5e0f35ee2239 tempest-CinderUnicodeTest-2129017985 None] Lock "cinder-5726717f-dc39-47cb-82bf-38aa3285eaf8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bce81514-fdfa-4084-90ac-5e0f35ee2239 tempest-CinderUnicodeTest-2129017985 None] Acquiring lock "cinder-quobyte-5726717f-dc39-47cb-82bf-38aa3285eaf8" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bce81514-fdfa-4084-90ac-5e0f35ee2239 tempest-CinderUnicodeTest-2129017985 None] Lock "cinder-quobyte-5726717f-dc39-47cb-82bf-38aa3285eaf8" acquired by "delete_volume" :: waited 0.022s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:01 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e70cbd6-e5f6-4ccf-897d-3bedd454dea3]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:50:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bce81514-fdfa-4084-90ac-5e0f35ee2239 tempest-CinderUnicodeTest-2129017985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5726717f-dc39-47cb-82bf-38aa3285eaf8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:01 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5726717f-dc39-47cb-82bf-38aa3285eaf8 Sep 16 17:50:01 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:01 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bce81514-fdfa-4084-90ac-5e0f35ee2239 tempest-CinderUnicodeTest-2129017985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5726717f-dc39-47cb-82bf-38aa3285eaf8" returned: 0 in 0.540s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bce81514-fdfa-4084-90ac-5e0f35ee2239 tempest-CinderUnicodeTest-2129017985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5726717f-dc39-47cb-82bf-38aa3285eaf8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:01 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5726717f-dc39-47cb-82bf-38aa3285eaf8 Sep 16 17:50:01 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:50:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:02 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:50:02 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:02 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bce81514-fdfa-4084-90ac-5e0f35ee2239 tempest-CinderUnicodeTest-2129017985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5726717f-dc39-47cb-82bf-38aa3285eaf8" returned: 0 in 0.491s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bce81514-fdfa-4084-90ac-5e0f35ee2239 tempest-CinderUnicodeTest-2129017985 None] Lock "cinder-quobyte-5726717f-dc39-47cb-82bf-38aa3285eaf8" released by "delete_volume" :: held 1.116s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:02 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:UPDATE=118,cinder:SELECT=111,cinder:INSERT=34,cinder:DELETE=11 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:50:02 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=101,cinder:UPDATE=131,cinder:INSERT=39,cinder:DELETE=11 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:50:02 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-bce81514-fdfa-4084-90ac-5e0f35ee2239 tempest-CinderUnicodeTest-2129017985 None] Created reservations ['791ee967-d7aa-448f-909d-1af2c89f3c12', 'dbdfc142-62d9-4e5c-8319-375838745846', '9e601924-b540-4bea-9df3-48b9185afe09', '3a12c1ed-2d1f-48e5-8901-7de2b2053719'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:50:02 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.461s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:50:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager._thread_info {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:50:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread count: 28 {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:50:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread info: [<_MainThread(MainThread, started 123748124422272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:50:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bce81514-fdfa-4084-90ac-5e0f35ee2239 tempest-CinderUnicodeTest-2129017985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bce81514-fdfa-4084-90ac-5e0f35ee2239 tempest-CinderUnicodeTest-2129017985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-bce81514-fdfa-4084-90ac-5e0f35ee2239 tempest-CinderUnicodeTest-2129017985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-bce81514-fdfa-4084-90ac-5e0f35ee2239 tempest-CinderUnicodeTest-2129017985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bce81514-fdfa-4084-90ac-5e0f35ee2239 tempest-CinderUnicodeTest-2129017985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bce81514-fdfa-4084-90ac-5e0f35ee2239 tempest-CinderUnicodeTest-2129017985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:02 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:50:02 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:03 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bce81514-fdfa-4084-90ac-5e0f35ee2239 tempest-CinderUnicodeTest-2129017985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.398s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:03 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-bce81514-fdfa-4084-90ac-5e0f35ee2239 tempest-CinderUnicodeTest-2129017985 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:50:03 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-bce81514-fdfa-4084-90ac-5e0f35ee2239 tempest-CinderUnicodeTest-2129017985 None] Deleted volume successfully. Sep 16 17:50:03 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bce81514-fdfa-4084-90ac-5e0f35ee2239 tempest-CinderUnicodeTest-2129017985 None] Lock "cinder-5726717f-dc39-47cb-82bf-38aa3285eaf8-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Flow 'volume_create_manager' (12103a2f-f03f-48d0-a0ab-a8bd06f8a959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd5d1e3-c7dd-4247-a22b-11f3cf76d9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd5d1e3-c7dd-4247-a22b-11f3cf76d9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1805485653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eede1f4-a475-432f-bd58-00df8392915b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc4810a41174d4ba7ab9157e4b5f26a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:50:11Z,use_quota=True,user_id='f047df3c04bd4744818b0dc4cd1483e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962ae8fe-582c-44ac-be5e-0da9c6bd0181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962ae8fe-582c-44ac-be5e-0da9c6bd0181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41382197-6bc5-4605-b675-c4e5ca40b6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41382197-6bc5-4605-b675-c4e5ca40b6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eede1f4-a475-432f-bd58-00df8392915b', 'volume_name': 'volume-7eede1f4-a475-432f-bd58-00df8392915b', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d113825a-7691-4932-ab7e-5e6e3f6a7b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d113825a-7691-4932-ab7e-5e6e3f6a7b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6947db6d-7765-4c41-ab5f-962a0d385049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:11 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Volume 7eede1f4-a475-432f-bd58-00df8392915b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eede1f4-a475-432f-bd58-00df8392915b', 'volume_size': 1} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1805485653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eede1f4-a475-432f-bd58-00df8392915b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc4810a41174d4ba7ab9157e4b5f26a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:50:11Z,use_quota=True,user_id='f047df3c04bd4744818b0dc4cd1483e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Creating volume 7eede1f4-a475-432f-bd58-00df8392915b {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:50:11 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7eede1f4-a475-432f-bd58-00df8392915b 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:11 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7eede1f4-a475-432f-bd58-00df8392915b 1073741824 Sep 16 17:50:11 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:11 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7eede1f4-a475-432f-bd58-00df8392915b 1073741824" returned: 0 in 0.533s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7eede1f4-a475-432f-bd58-00df8392915b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:11 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7eede1f4-a475-432f-bd58-00df8392915b Sep 16 17:50:11 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:11 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7eede1f4-a475-432f-bd58-00df8392915b" returned: 0 in 0.272s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:50:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:12 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6947db6d-7765-4c41-ab5f-962a0d385049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eede1f4-a475-432f-bd58-00df8392915b', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:12 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a4f7fc-c5bf-43a2-a40c-978e3298e389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:12 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Volume volume-7eede1f4-a475-432f-bd58-00df8392915b (7eede1f4-a475-432f-bd58-00df8392915b): created successfully Sep 16 17:50:12 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a4f7fc-c5bf-43a2-a40c-978e3298e389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:12 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Flow 'volume_create_manager' (12103a2f-f03f-48d0-a0ab-a8bd06f8a959) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:50:12 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-a973e468-8c41-4b3c-819d-0b8c8e79ac3b tempest-VolumesListAdminTestJSON-1584194466 None] Created volume successfully. Sep 16 17:50:13 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:50:13 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Flow 'volume_create_manager' (acd4a492-dcc7-418a-91cc-730f1797d623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:50:13 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109d8faa-dd52-4553-b9d8-1722cabbf1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:13 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109d8faa-dd52-4553-b9d8-1722cabbf1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1224919660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35169a69-4cb9-4b82-9e2f-a009c38d946f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc4810a41174d4ba7ab9157e4b5f26a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:50:14Z,use_quota=True,user_id='f047df3c04bd4744818b0dc4cd1483e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:13 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae9c67a-e6d5-4c64-a4c7-c79b51d9b946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:13 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae9c67a-e6d5-4c64-a4c7-c79b51d9b946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:13 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25eeee7c-a6e9-42a4-be83-cc3ead62cdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:13 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25eeee7c-a6e9-42a4-be83-cc3ead62cdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35169a69-4cb9-4b82-9e2f-a009c38d946f', 'volume_name': 'volume-35169a69-4cb9-4b82-9e2f-a009c38d946f', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:13 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11916ebc-4663-4cb4-9b6f-da2290e21935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:13 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11916ebc-4663-4cb4-9b6f-da2290e21935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:13 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596c954c-a2de-4c0f-9d8f-086cfa0207cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:13 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Volume 35169a69-4cb9-4b82-9e2f-a009c38d946f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35169a69-4cb9-4b82-9e2f-a009c38d946f', 'volume_size': 1} Sep 16 17:50:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:13 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1224919660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35169a69-4cb9-4b82-9e2f-a009c38d946f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc4810a41174d4ba7ab9157e4b5f26a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:50:14Z,use_quota=True,user_id='f047df3c04bd4744818b0dc4cd1483e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:50:13 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Creating volume 35169a69-4cb9-4b82-9e2f-a009c38d946f {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:50:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:13 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:13 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:13 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:50:13 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:50:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-35169a69-4cb9-4b82-9e2f-a009c38d946f 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:13 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-35169a69-4cb9-4b82-9e2f-a009c38d946f 1073741824 Sep 16 17:50:13 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Flow 'volume_create_manager' (ab1e4801-606f-43b0-9673-11dbc8ac5792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a34d6a8-9654-4c00-9f2b-059553b20f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a34d6a8-9654-4c00-9f2b-059553b20f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1484458465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=345a02d7-5959-4905-b9e3-e9b60cb79368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291cb04fcbd64af39d3076fdaa57a733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:50:14Z,use_quota=True,user_id='dd1d9aa092884363a64f0a27228c866a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f04b894-b2b2-40b2-b5a9-d34fd7929a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:14 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f04b894-b2b2-40b2-b5a9-d34fd7929a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b054d30a-89ff-4779-b18e-88d999d0d25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b054d30a-89ff-4779-b18e-88d999d0d25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '345a02d7-5959-4905-b9e3-e9b60cb79368', 'volume_name': 'volume-345a02d7-5959-4905-b9e3-e9b60cb79368', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739e013a-40f6-4728-8207-0a55981afcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739e013a-40f6-4728-8207-0a55981afcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479980e3-804c-4d49-bf65-a60cde4c4369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:14 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Volume 345a02d7-5959-4905-b9e3-e9b60cb79368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-345a02d7-5959-4905-b9e3-e9b60cb79368', 'volume_size': 1} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-35169a69-4cb9-4b82-9e2f-a009c38d946f 1073741824" returned: 0 in 0.537s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-35169a69-4cb9-4b82-9e2f-a009c38d946f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:14 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-35169a69-4cb9-4b82-9e2f-a009c38d946f Sep 16 17:50:14 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:14 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-35169a69-4cb9-4b82-9e2f-a009c38d946f" returned: 0 in 0.268s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.304s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1484458465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=345a02d7-5959-4905-b9e3-e9b60cb79368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291cb04fcbd64af39d3076fdaa57a733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:50:14Z,use_quota=True,user_id='dd1d9aa092884363a64f0a27228c866a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Creating volume 345a02d7-5959-4905-b9e3-e9b60cb79368 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:50:14 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-345a02d7-5959-4905-b9e3-e9b60cb79368 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:14 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-345a02d7-5959-4905-b9e3-e9b60cb79368 1073741824 Sep 16 17:50:14 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596c954c-a2de-4c0f-9d8f-086cfa0207cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35169a69-4cb9-4b82-9e2f-a009c38d946f', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300740b6-be1f-4986-90df-ab97d75a2886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:14 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Volume volume-35169a69-4cb9-4b82-9e2f-a009c38d946f (35169a69-4cb9-4b82-9e2f-a009c38d946f): created successfully Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300740b6-be1f-4986-90df-ab97d75a2886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Flow 'volume_create_manager' (acd4a492-dcc7-418a-91cc-730f1797d623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:50:14 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-b993d629-6b2a-4a69-8c4c-9942fcf8d8e3 tempest-VolumesListAdminTestJSON-1584194466 None] Created volume successfully. Sep 16 17:50:15 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-345a02d7-5959-4905-b9e3-e9b60cb79368 1073741824" returned: 0 in 0.425s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-345a02d7-5959-4905-b9e3-e9b60cb79368 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:15 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-345a02d7-5959-4905-b9e3-e9b60cb79368 Sep 16 17:50:15 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:15 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-345a02d7-5959-4905-b9e3-e9b60cb79368" returned: 0 in 0.244s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:50:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479980e3-804c-4d49-bf65-a60cde4c4369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-345a02d7-5959-4905-b9e3-e9b60cb79368', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d45ce02-29e4-4ef7-bab7-214fdd3fbbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:15 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Volume volume-345a02d7-5959-4905-b9e3-e9b60cb79368 (345a02d7-5959-4905-b9e3-e9b60cb79368): created successfully Sep 16 17:50:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d45ce02-29e4-4ef7-bab7-214fdd3fbbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Flow 'volume_create_manager' (ab1e4801-606f-43b0-9673-11dbc8ac5792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:50:15 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5c790fd4-8361-4801-a6b3-db2b97b18b00 tempest-ProjectReaderTests-1091764089 None] Created volume successfully. Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Flow 'volume_create_manager' (7a95fda3-726c-427f-9609-8ac3452c6a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e4900fd-4406-4119-a8ca-01c12a635759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e4900fd-4406-4119-a8ca-01c12a635759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-277987368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c9e040-74d8-4914-8c0b-588e9e754e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc4810a41174d4ba7ab9157e4b5f26a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:50:16Z,use_quota=True,user_id='f047df3c04bd4744818b0dc4cd1483e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63dc0f4f-1ddd-4810-9907-46329933798f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63dc0f4f-1ddd-4810-9907-46329933798f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449e5c6a-96a5-420b-b077-34bc3d989a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449e5c6a-96a5-420b-b077-34bc3d989a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53c9e040-74d8-4914-8c0b-588e9e754e41', 'volume_name': 'volume-53c9e040-74d8-4914-8c0b-588e9e754e41', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07909b58-8326-4e19-a69b-61d8218a0c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07909b58-8326-4e19-a69b-61d8218a0c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668edf01-1633-47ab-8fd5-a438a26907af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:16 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Volume 53c9e040-74d8-4914-8c0b-588e9e754e41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53c9e040-74d8-4914-8c0b-588e9e754e41', 'volume_size': 1} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-277987368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c9e040-74d8-4914-8c0b-588e9e754e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc4810a41174d4ba7ab9157e4b5f26a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:50:16Z,use_quota=True,user_id='f047df3c04bd4744818b0dc4cd1483e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Creating volume 53c9e040-74d8-4914-8c0b-588e9e754e41 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:50:16 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53c9e040-74d8-4914-8c0b-588e9e754e41 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:16 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53c9e040-74d8-4914-8c0b-588e9e754e41 1073741824 Sep 16 17:50:16 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-95e5cd50-c4e1-4f47-801b-1e917e1c705f tempest-ProjectReaderTests-1091764089 None] Acquiring lock "cinder-345a02d7-5959-4905-b9e3-e9b60cb79368-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-95e5cd50-c4e1-4f47-801b-1e917e1c705f tempest-ProjectReaderTests-1091764089 None] Lock "cinder-345a02d7-5959-4905-b9e3-e9b60cb79368-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-95e5cd50-c4e1-4f47-801b-1e917e1c705f tempest-ProjectReaderTests-1091764089 None] Acquiring lock "cinder-quobyte-345a02d7-5959-4905-b9e3-e9b60cb79368" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-95e5cd50-c4e1-4f47-801b-1e917e1c705f tempest-ProjectReaderTests-1091764089 None] Lock "cinder-quobyte-345a02d7-5959-4905-b9e3-e9b60cb79368" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[be96d8ca-4045-4d9c-ba81-6943fa34936b]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-95e5cd50-c4e1-4f47-801b-1e917e1c705f tempest-ProjectReaderTests-1091764089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-345a02d7-5959-4905-b9e3-e9b60cb79368 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:16 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-345a02d7-5959-4905-b9e3-e9b60cb79368 Sep 16 17:50:16 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:16 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53c9e040-74d8-4914-8c0b-588e9e754e41 1073741824" returned: 0 in 0.489s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53c9e040-74d8-4914-8c0b-588e9e754e41 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:16 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53c9e040-74d8-4914-8c0b-588e9e754e41 Sep 16 17:50:16 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:16 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-95e5cd50-c4e1-4f47-801b-1e917e1c705f tempest-ProjectReaderTests-1091764089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-345a02d7-5959-4905-b9e3-e9b60cb79368" returned: 0 in 0.409s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-95e5cd50-c4e1-4f47-801b-1e917e1c705f tempest-ProjectReaderTests-1091764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-345a02d7-5959-4905-b9e3-e9b60cb79368 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:16 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-345a02d7-5959-4905-b9e3-e9b60cb79368 Sep 16 17:50:16 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:17 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53c9e040-74d8-4914-8c0b-588e9e754e41" returned: 0 in 0.257s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:50:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668edf01-1633-47ab-8fd5-a438a26907af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53c9e040-74d8-4914-8c0b-588e9e754e41', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff45d66-a337-44bb-9eb9-0ac1a49333b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:17 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Volume volume-53c9e040-74d8-4914-8c0b-588e9e754e41 (53c9e040-74d8-4914-8c0b-588e9e754e41): created successfully Sep 16 17:50:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff45d66-a337-44bb-9eb9-0ac1a49333b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Flow 'volume_create_manager' (7a95fda3-726c-427f-9609-8ac3452c6a0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:50:17 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-8f0c54aa-e37c-4a5c-9e19-3c768ae3e430 tempest-VolumesListAdminTestJSON-1584194466 None] Created volume successfully. Sep 16 17:50:17 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-95e5cd50-c4e1-4f47-801b-1e917e1c705f tempest-ProjectReaderTests-1091764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-345a02d7-5959-4905-b9e3-e9b60cb79368" returned: 0 in 0.272s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-95e5cd50-c4e1-4f47-801b-1e917e1c705f tempest-ProjectReaderTests-1091764089 None] Lock "cinder-quobyte-345a02d7-5959-4905-b9e3-e9b60cb79368" released by "delete_volume" :: held 0.733s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:17 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-95e5cd50-c4e1-4f47-801b-1e917e1c705f tempest-ProjectReaderTests-1091764089 None] Created reservations ['5d3330c1-61d0-48ae-b584-da790315db56', '269431ab-b1da-40a4-b2ed-9bb8f3e7a794', '12a53500-010c-4bbe-8b95-1b7a0cef86c8', 'dbbb8d08-375b-4e81-94d1-f97afeee7995'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:50:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-95e5cd50-c4e1-4f47-801b-1e917e1c705f tempest-ProjectReaderTests-1091764089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-95e5cd50-c4e1-4f47-801b-1e917e1c705f tempest-ProjectReaderTests-1091764089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-95e5cd50-c4e1-4f47-801b-1e917e1c705f tempest-ProjectReaderTests-1091764089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-95e5cd50-c4e1-4f47-801b-1e917e1c705f tempest-ProjectReaderTests-1091764089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-95e5cd50-c4e1-4f47-801b-1e917e1c705f tempest-ProjectReaderTests-1091764089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-95e5cd50-c4e1-4f47-801b-1e917e1c705f tempest-ProjectReaderTests-1091764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:17 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:50:17 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:17 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-95e5cd50-c4e1-4f47-801b-1e917e1c705f tempest-ProjectReaderTests-1091764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.265s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:17 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-95e5cd50-c4e1-4f47-801b-1e917e1c705f tempest-ProjectReaderTests-1091764089 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:50:17 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-95e5cd50-c4e1-4f47-801b-1e917e1c705f tempest-ProjectReaderTests-1091764089 None] Deleted volume successfully. Sep 16 17:50:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-95e5cd50-c4e1-4f47-801b-1e917e1c705f tempest-ProjectReaderTests-1091764089 None] Lock "cinder-345a02d7-5959-4905-b9e3-e9b60cb79368-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Flow 'volume_create_manager' (c735d07d-ad52-4d2f-a204-024e39b22d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860bd961-c309-4fd0-b60d-a4091bf83b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860bd961-c309-4fd0-b60d-a4091bf83b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-239992578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d53be0-04a1-4ddd-b0dc-38e74819d3c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291cb04fcbd64af39d3076fdaa57a733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:50:18Z,use_quota=True,user_id='dd1d9aa092884363a64f0a27228c866a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b49e6d11-a067-4354-9a65-9d63656e6b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b49e6d11-a067-4354-9a65-9d63656e6b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ca6bdd-e2ce-45a9-8dc5-6f9f48b10a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ca6bdd-e2ce-45a9-8dc5-6f9f48b10a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15d53be0-04a1-4ddd-b0dc-38e74819d3c8', 'volume_name': 'volume-15d53be0-04a1-4ddd-b0dc-38e74819d3c8', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7faf5dc-c983-4aaf-8cd6-b52f73b19e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7faf5dc-c983-4aaf-8cd6-b52f73b19e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0315e66-fb18-41ee-a792-4b1e4c9fbf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:18 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Volume 15d53be0-04a1-4ddd-b0dc-38e74819d3c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15d53be0-04a1-4ddd-b0dc-38e74819d3c8', 'volume_size': 1} Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-239992578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d53be0-04a1-4ddd-b0dc-38e74819d3c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291cb04fcbd64af39d3076fdaa57a733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:50:18Z,use_quota=True,user_id='dd1d9aa092884363a64f0a27228c866a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Creating volume 15d53be0-04a1-4ddd-b0dc-38e74819d3c8 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:50:18 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-15d53be0-04a1-4ddd-b0dc-38e74819d3c8 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:18 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-15d53be0-04a1-4ddd-b0dc-38e74819d3c8 1073741824 Sep 16 17:50:18 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:18 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-15d53be0-04a1-4ddd-b0dc-38e74819d3c8 1073741824" returned: 0 in 0.535s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-15d53be0-04a1-4ddd-b0dc-38e74819d3c8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:18 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-15d53be0-04a1-4ddd-b0dc-38e74819d3c8 Sep 16 17:50:18 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:19 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-15d53be0-04a1-4ddd-b0dc-38e74819d3c8" returned: 0 in 0.446s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0315e66-fb18-41ee-a792-4b1e4c9fbf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15d53be0-04a1-4ddd-b0dc-38e74819d3c8', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da4a904-646c-4963-8395-1b71c3939d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:19 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Volume volume-15d53be0-04a1-4ddd-b0dc-38e74819d3c8 (15d53be0-04a1-4ddd-b0dc-38e74819d3c8): created successfully Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da4a904-646c-4963-8395-1b71c3939d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Flow 'volume_create_manager' (c735d07d-ad52-4d2f-a204-024e39b22d07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:50:19 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-b3f3ee31-1e10-4bb5-a9dc-6837ec9663b4 tempest-ProjectReaderTests-1091764089 None] Created volume successfully. Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Flow 'volume_create_manager' (4545b630-c787-48b8-8768-15a16611d3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b537bd92-a107-4a7b-801e-776627d71bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b537bd92-a107-4a7b-801e-776627d71bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4672ec05-a99f-40f6-a3db-03e1bf0fda94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a776ae5d5a4420be976488c5d02a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:50:19Z,use_quota=True,user_id='5fd0129b0eee415b822bf917a3028de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81de5eae-ee13-4faa-98ab-223d831ed77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81de5eae-ee13-4faa-98ab-223d831ed77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4c6dae-1486-4a80-ada5-c78a5b815bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4c6dae-1486-4a80-ada5-c78a5b815bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4672ec05-a99f-40f6-a3db-03e1bf0fda94', 'volume_name': 'volume-4672ec05-a99f-40f6-a3db-03e1bf0fda94', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454c6e04-e5a3-4db7-aba4-e879e710abc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454c6e04-e5a3-4db7-aba4-e879e710abc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261a9b54-8f0a-406b-82af-c7ffa6e26642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:19 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Volume 4672ec05-a99f-40f6-a3db-03e1bf0fda94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4672ec05-a99f-40f6-a3db-03e1bf0fda94', 'volume_size': 1} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4672ec05-a99f-40f6-a3db-03e1bf0fda94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a776ae5d5a4420be976488c5d02a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:50:19Z,use_quota=True,user_id='5fd0129b0eee415b822bf917a3028de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Creating volume 4672ec05-a99f-40f6-a3db-03e1bf0fda94 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:50:19 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4672ec05-a99f-40f6-a3db-03e1bf0fda94 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:19 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4672ec05-a99f-40f6-a3db-03e1bf0fda94 1073741824 Sep 16 17:50:19 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:19 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4672ec05-a99f-40f6-a3db-03e1bf0fda94 1073741824" returned: 0 in 0.453s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4672ec05-a99f-40f6-a3db-03e1bf0fda94 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:19 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4672ec05-a99f-40f6-a3db-03e1bf0fda94 Sep 16 17:50:19 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:20 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4672ec05-a99f-40f6-a3db-03e1bf0fda94" returned: 0 in 0.320s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:50:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261a9b54-8f0a-406b-82af-c7ffa6e26642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4672ec05-a99f-40f6-a3db-03e1bf0fda94', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50c5636-352d-4ff5-ac64-1c29ef1c64a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:20 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Volume volume-4672ec05-a99f-40f6-a3db-03e1bf0fda94 (4672ec05-a99f-40f6-a3db-03e1bf0fda94): created successfully Sep 16 17:50:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50c5636-352d-4ff5-ac64-1c29ef1c64a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Flow 'volume_create_manager' (4545b630-c787-48b8-8768-15a16611d3fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:50:20 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-e20802f5-a055-41ed-a660-c23c7266d067 tempest-VolumesListAdminTestJSON-349274985 None] Created volume successfully. Sep 16 17:50:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-89b7334e-ba7d-4be6-9c9c-14519d03acac tempest-ProjectReaderTests-1091764089 None] Acquiring lock "cinder-15d53be0-04a1-4ddd-b0dc-38e74819d3c8-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-89b7334e-ba7d-4be6-9c9c-14519d03acac tempest-ProjectReaderTests-1091764089 None] Lock "cinder-15d53be0-04a1-4ddd-b0dc-38e74819d3c8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-89b7334e-ba7d-4be6-9c9c-14519d03acac tempest-ProjectReaderTests-1091764089 None] Acquiring lock "cinder-quobyte-15d53be0-04a1-4ddd-b0dc-38e74819d3c8" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-89b7334e-ba7d-4be6-9c9c-14519d03acac tempest-ProjectReaderTests-1091764089 None] Lock "cinder-quobyte-15d53be0-04a1-4ddd-b0dc-38e74819d3c8" acquired by "delete_volume" :: waited 0.014s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:20 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4ecf1d-4201-4920-b0bf-f9f3369c3da2]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:50:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-89b7334e-ba7d-4be6-9c9c-14519d03acac tempest-ProjectReaderTests-1091764089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-15d53be0-04a1-4ddd-b0dc-38e74819d3c8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:20 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-15d53be0-04a1-4ddd-b0dc-38e74819d3c8 Sep 16 17:50:20 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:20 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-89b7334e-ba7d-4be6-9c9c-14519d03acac tempest-ProjectReaderTests-1091764089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-15d53be0-04a1-4ddd-b0dc-38e74819d3c8" returned: 0 in 0.375s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-89b7334e-ba7d-4be6-9c9c-14519d03acac tempest-ProjectReaderTests-1091764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-15d53be0-04a1-4ddd-b0dc-38e74819d3c8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:20 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-15d53be0-04a1-4ddd-b0dc-38e74819d3c8 Sep 16 17:50:20 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:21 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-89b7334e-ba7d-4be6-9c9c-14519d03acac tempest-ProjectReaderTests-1091764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-15d53be0-04a1-4ddd-b0dc-38e74819d3c8" returned: 0 in 0.272s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-89b7334e-ba7d-4be6-9c9c-14519d03acac tempest-ProjectReaderTests-1091764089 None] Lock "cinder-quobyte-15d53be0-04a1-4ddd-b0dc-38e74819d3c8" released by "delete_volume" :: held 0.696s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-89b7334e-ba7d-4be6-9c9c-14519d03acac tempest-ProjectReaderTests-1091764089 None] Created reservations ['6e5dd8e3-af12-4a9b-a95b-0aa58f9a5748', 'fdcb9c9f-b2c9-4086-b4ad-eeea7161b159', '8b640139-d555-4925-a28f-175ffe257aaf', '9576f820-a9b6-4aa3-ad0a-9f4b0a526b6e'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-89b7334e-ba7d-4be6-9c9c-14519d03acac tempest-ProjectReaderTests-1091764089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-89b7334e-ba7d-4be6-9c9c-14519d03acac tempest-ProjectReaderTests-1091764089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-89b7334e-ba7d-4be6-9c9c-14519d03acac tempest-ProjectReaderTests-1091764089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-89b7334e-ba7d-4be6-9c9c-14519d03acac tempest-ProjectReaderTests-1091764089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-89b7334e-ba7d-4be6-9c9c-14519d03acac tempest-ProjectReaderTests-1091764089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-89b7334e-ba7d-4be6-9c9c-14519d03acac tempest-ProjectReaderTests-1091764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:21 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:50:21 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ea0ed918-05c7-40eb-9e46-36871b519e2a tempest-VolumesListAdminTestJSON-349274985 None] Acquiring lock "cinder-4672ec05-a99f-40f6-a3db-03e1bf0fda94-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:21 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-89b7334e-ba7d-4be6-9c9c-14519d03acac tempest-ProjectReaderTests-1091764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.279s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-89b7334e-ba7d-4be6-9c9c-14519d03acac tempest-ProjectReaderTests-1091764089 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ea0ed918-05c7-40eb-9e46-36871b519e2a tempest-VolumesListAdminTestJSON-349274985 None] Lock "cinder-4672ec05-a99f-40f6-a3db-03e1bf0fda94-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:21 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-89b7334e-ba7d-4be6-9c9c-14519d03acac tempest-ProjectReaderTests-1091764089 None] Deleted volume successfully. Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-89b7334e-ba7d-4be6-9c9c-14519d03acac tempest-ProjectReaderTests-1091764089 None] Lock "cinder-15d53be0-04a1-4ddd-b0dc-38e74819d3c8-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ea0ed918-05c7-40eb-9e46-36871b519e2a tempest-VolumesListAdminTestJSON-349274985 None] Acquiring lock "cinder-quobyte-4672ec05-a99f-40f6-a3db-03e1bf0fda94" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ea0ed918-05c7-40eb-9e46-36871b519e2a tempest-VolumesListAdminTestJSON-349274985 None] Lock "cinder-quobyte-4672ec05-a99f-40f6-a3db-03e1bf0fda94" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0c436563-e23d-48e1-9f0c-91efa96c2d2c tempest-VolumesListAdminTestJSON-1584194466 None] Acquiring lock "cinder-53c9e040-74d8-4914-8c0b-588e9e754e41-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f493e2-2c09-4a91-890d-f1d94e18092f]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ea0ed918-05c7-40eb-9e46-36871b519e2a tempest-VolumesListAdminTestJSON-349274985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4672ec05-a99f-40f6-a3db-03e1bf0fda94 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0c436563-e23d-48e1-9f0c-91efa96c2d2c tempest-VolumesListAdminTestJSON-1584194466 None] Lock "cinder-53c9e040-74d8-4914-8c0b-588e9e754e41-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0c436563-e23d-48e1-9f0c-91efa96c2d2c tempest-VolumesListAdminTestJSON-1584194466 None] Acquiring lock "cinder-quobyte-53c9e040-74d8-4914-8c0b-588e9e754e41" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0c436563-e23d-48e1-9f0c-91efa96c2d2c tempest-VolumesListAdminTestJSON-1584194466 None] Lock "cinder-quobyte-53c9e040-74d8-4914-8c0b-588e9e754e41" acquired by "delete_volume" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66b9bcf-04c5-483c-85fc-528ade8e5642]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:50:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0c436563-e23d-48e1-9f0c-91efa96c2d2c tempest-VolumesListAdminTestJSON-1584194466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53c9e040-74d8-4914-8c0b-588e9e754e41 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:21 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4672ec05-a99f-40f6-a3db-03e1bf0fda94 Sep 16 17:50:21 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:21 devstack sudo[100035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53c9e040-74d8-4914-8c0b-588e9e754e41 Sep 16 17:50:21 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:50:22 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Flow 'volume_create_manager' (33108b15-409c-4e4a-aaf1-81539329ada2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63e6674-23a3-4236-a345-3673044eb089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63e6674-23a3-4236-a345-3673044eb089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-944160495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89afed6-3401-4efb-a5ed-d1f0ce4b08b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291cb04fcbd64af39d3076fdaa57a733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:50:22Z,use_quota=True,user_id='dd1d9aa092884363a64f0a27228c866a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73544274-dcd6-4435-a579-be95e2541957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73544274-dcd6-4435-a579-be95e2541957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b12c3a-4f9b-4356-9d26-a77c94c471cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b12c3a-4f9b-4356-9d26-a77c94c471cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e89afed6-3401-4efb-a5ed-d1f0ce4b08b2', 'volume_name': 'volume-e89afed6-3401-4efb-a5ed-d1f0ce4b08b2', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c60383-676f-4e93-842a-ce3586679ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c60383-676f-4e93-842a-ce3586679ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a6e303-34da-44b8-a45a-77785e19b587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:22 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Volume e89afed6-3401-4efb-a5ed-d1f0ce4b08b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e89afed6-3401-4efb-a5ed-d1f0ce4b08b2', 'volume_size': 1} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-944160495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89afed6-3401-4efb-a5ed-d1f0ce4b08b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291cb04fcbd64af39d3076fdaa57a733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:50:22Z,use_quota=True,user_id='dd1d9aa092884363a64f0a27228c866a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Creating volume e89afed6-3401-4efb-a5ed-d1f0ce4b08b2 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:22 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:50:22 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e89afed6-3401-4efb-a5ed-d1f0ce4b08b2 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ea0ed918-05c7-40eb-9e46-36871b519e2a tempest-VolumesListAdminTestJSON-349274985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4672ec05-a99f-40f6-a3db-03e1bf0fda94" returned: 0 in 0.548s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ea0ed918-05c7-40eb-9e46-36871b519e2a tempest-VolumesListAdminTestJSON-349274985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4672ec05-a99f-40f6-a3db-03e1bf0fda94 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0c436563-e23d-48e1-9f0c-91efa96c2d2c tempest-VolumesListAdminTestJSON-1584194466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53c9e040-74d8-4914-8c0b-588e9e754e41" returned: 0 in 0.447s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:22 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e89afed6-3401-4efb-a5ed-d1f0ce4b08b2 1073741824 Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0c436563-e23d-48e1-9f0c-91efa96c2d2c tempest-VolumesListAdminTestJSON-1584194466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53c9e040-74d8-4914-8c0b-588e9e754e41 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:22 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:22 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4672ec05-a99f-40f6-a3db-03e1bf0fda94 Sep 16 17:50:22 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:22 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53c9e040-74d8-4914-8c0b-588e9e754e41 Sep 16 17:50:22 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:22 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ea0ed918-05c7-40eb-9e46-36871b519e2a tempest-VolumesListAdminTestJSON-349274985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4672ec05-a99f-40f6-a3db-03e1bf0fda94" returned: 0 in 0.274s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:22 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0c436563-e23d-48e1-9f0c-91efa96c2d2c tempest-VolumesListAdminTestJSON-1584194466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53c9e040-74d8-4914-8c0b-588e9e754e41" returned: 0 in 0.273s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ea0ed918-05c7-40eb-9e46-36871b519e2a tempest-VolumesListAdminTestJSON-349274985 None] Lock "cinder-quobyte-4672ec05-a99f-40f6-a3db-03e1bf0fda94" released by "delete_volume" :: held 0.891s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0c436563-e23d-48e1-9f0c-91efa96c2d2c tempest-VolumesListAdminTestJSON-1584194466 None] Lock "cinder-quobyte-53c9e040-74d8-4914-8c0b-588e9e754e41" released by "delete_volume" :: held 0.776s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-ea0ed918-05c7-40eb-9e46-36871b519e2a tempest-VolumesListAdminTestJSON-349274985 None] Created reservations ['5e951ef5-4f91-4ebc-b1c2-e7e6f3767820', '21a823df-697e-43a2-b34c-d41eb83d36fb', '30bdf121-2b0e-4de0-b296-5a4d2846a79b', 'dacd60c0-ecca-4b76-b63c-c16aaa86e47c'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-0c436563-e23d-48e1-9f0c-91efa96c2d2c tempest-VolumesListAdminTestJSON-1584194466 None] Created reservations ['5ff44ac4-64e5-439f-9aaa-7898adead838', '007039a5-b946-40e1-8b0a-b8c8d1f87323', '869fd3e5-baf6-4100-b440-8c9c1fc0ff52', '4b867c57-5cf9-4402-a1eb-4d0f12f8ca09'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:50:22 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ea0ed918-05c7-40eb-9e46-36871b519e2a tempest-VolumesListAdminTestJSON-349274985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ea0ed918-05c7-40eb-9e46-36871b519e2a tempest-VolumesListAdminTestJSON-349274985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ea0ed918-05c7-40eb-9e46-36871b519e2a tempest-VolumesListAdminTestJSON-349274985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ea0ed918-05c7-40eb-9e46-36871b519e2a tempest-VolumesListAdminTestJSON-349274985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ea0ed918-05c7-40eb-9e46-36871b519e2a tempest-VolumesListAdminTestJSON-349274985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ea0ed918-05c7-40eb-9e46-36871b519e2a tempest-VolumesListAdminTestJSON-349274985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e89afed6-3401-4efb-a5ed-d1f0ce4b08b2 1073741824" returned: 0 in 0.499s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:22 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:50:22 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0c436563-e23d-48e1-9f0c-91efa96c2d2c tempest-VolumesListAdminTestJSON-1584194466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0c436563-e23d-48e1-9f0c-91efa96c2d2c tempest-VolumesListAdminTestJSON-1584194466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0c436563-e23d-48e1-9f0c-91efa96c2d2c tempest-VolumesListAdminTestJSON-1584194466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0c436563-e23d-48e1-9f0c-91efa96c2d2c tempest-VolumesListAdminTestJSON-1584194466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0c436563-e23d-48e1-9f0c-91efa96c2d2c tempest-VolumesListAdminTestJSON-1584194466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0c436563-e23d-48e1-9f0c-91efa96c2d2c tempest-VolumesListAdminTestJSON-1584194466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:22 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:50:22 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e89afed6-3401-4efb-a5ed-d1f0ce4b08b2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:22 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e89afed6-3401-4efb-a5ed-d1f0ce4b08b2 Sep 16 17:50:22 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8ce00f4d-af2f-408b-a1bc-1267c0a6b2fc tempest-VolumesListAdminTestJSON-1584194466 None] Acquiring lock "cinder-35169a69-4cb9-4b82-9e2f-a009c38d946f-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8ce00f4d-af2f-408b-a1bc-1267c0a6b2fc tempest-VolumesListAdminTestJSON-1584194466 None] Lock "cinder-35169a69-4cb9-4b82-9e2f-a009c38d946f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8ce00f4d-af2f-408b-a1bc-1267c0a6b2fc tempest-VolumesListAdminTestJSON-1584194466 None] Acquiring lock "cinder-quobyte-35169a69-4cb9-4b82-9e2f-a009c38d946f" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8ce00f4d-af2f-408b-a1bc-1267c0a6b2fc tempest-VolumesListAdminTestJSON-1584194466 None] Lock "cinder-quobyte-35169a69-4cb9-4b82-9e2f-a009c38d946f" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:22 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ea0ed918-05c7-40eb-9e46-36871b519e2a tempest-VolumesListAdminTestJSON-349274985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.333s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:22 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-ea0ed918-05c7-40eb-9e46-36871b519e2a tempest-VolumesListAdminTestJSON-349274985 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:50:22 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-ea0ed918-05c7-40eb-9e46-36871b519e2a tempest-VolumesListAdminTestJSON-349274985 None] Deleted volume successfully. Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e5747f-c7e3-4b9f-ab5f-072d2df0170b]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8ce00f4d-af2f-408b-a1bc-1267c0a6b2fc tempest-VolumesListAdminTestJSON-1584194466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-35169a69-4cb9-4b82-9e2f-a009c38d946f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:23 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0c436563-e23d-48e1-9f0c-91efa96c2d2c tempest-VolumesListAdminTestJSON-1584194466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.314s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-0c436563-e23d-48e1-9f0c-91efa96c2d2c tempest-VolumesListAdminTestJSON-1584194466 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:50:23 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-0c436563-e23d-48e1-9f0c-91efa96c2d2c tempest-VolumesListAdminTestJSON-1584194466 None] Deleted volume successfully. Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ea0ed918-05c7-40eb-9e46-36871b519e2a tempest-VolumesListAdminTestJSON-349274985 None] Lock "cinder-4672ec05-a99f-40f6-a3db-03e1bf0fda94-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0c436563-e23d-48e1-9f0c-91efa96c2d2c tempest-VolumesListAdminTestJSON-1584194466 None] Lock "cinder-53c9e040-74d8-4914-8c0b-588e9e754e41-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:23 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:23 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-35169a69-4cb9-4b82-9e2f-a009c38d946f Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e89afed6-3401-4efb-a5ed-d1f0ce4b08b2" returned: 0 in 0.400s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:23 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a6e303-34da-44b8-a45a-77785e19b587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e89afed6-3401-4efb-a5ed-d1f0ce4b08b2', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc25e81d-265d-4b94-bf6b-20045369cf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:23 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Volume volume-e89afed6-3401-4efb-a5ed-d1f0ce4b08b2 (e89afed6-3401-4efb-a5ed-d1f0ce4b08b2): created successfully Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc25e81d-265d-4b94-bf6b-20045369cf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Flow 'volume_create_manager' (33108b15-409c-4e4a-aaf1-81539329ada2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:50:23 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-c5897fbc-265b-4866-8d1c-d3188d5e1e51 tempest-ProjectReaderTests-1091764089 None] Created volume successfully. Sep 16 17:50:23 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8ce00f4d-af2f-408b-a1bc-1267c0a6b2fc tempest-VolumesListAdminTestJSON-1584194466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-35169a69-4cb9-4b82-9e2f-a009c38d946f" returned: 0 in 0.399s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8ce00f4d-af2f-408b-a1bc-1267c0a6b2fc tempest-VolumesListAdminTestJSON-1584194466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-35169a69-4cb9-4b82-9e2f-a009c38d946f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:23 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-35169a69-4cb9-4b82-9e2f-a009c38d946f Sep 16 17:50:23 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:23 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8ce00f4d-af2f-408b-a1bc-1267c0a6b2fc tempest-VolumesListAdminTestJSON-1584194466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-35169a69-4cb9-4b82-9e2f-a009c38d946f" returned: 0 in 0.272s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8ce00f4d-af2f-408b-a1bc-1267c0a6b2fc tempest-VolumesListAdminTestJSON-1584194466 None] Lock "cinder-quobyte-35169a69-4cb9-4b82-9e2f-a009c38d946f" released by "delete_volume" :: held 0.739s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-8ce00f4d-af2f-408b-a1bc-1267c0a6b2fc tempest-VolumesListAdminTestJSON-1584194466 None] Created reservations ['8a21a268-5a01-4cac-980a-1c76bb40576a', '75b35c9d-217f-46b0-9aa8-5d4aa0169197', '7d93530a-d168-4712-aab5-24c2fae82215', '3486487a-fb1f-4c4e-82c9-37186d29f564'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8ce00f4d-af2f-408b-a1bc-1267c0a6b2fc tempest-VolumesListAdminTestJSON-1584194466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8ce00f4d-af2f-408b-a1bc-1267c0a6b2fc tempest-VolumesListAdminTestJSON-1584194466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8ce00f4d-af2f-408b-a1bc-1267c0a6b2fc tempest-VolumesListAdminTestJSON-1584194466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8ce00f4d-af2f-408b-a1bc-1267c0a6b2fc tempest-VolumesListAdminTestJSON-1584194466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8ce00f4d-af2f-408b-a1bc-1267c0a6b2fc tempest-VolumesListAdminTestJSON-1584194466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8ce00f4d-af2f-408b-a1bc-1267c0a6b2fc tempest-VolumesListAdminTestJSON-1584194466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:23 devstack sudo[100076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:50:23 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:24 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8ce00f4d-af2f-408b-a1bc-1267c0a6b2fc tempest-VolumesListAdminTestJSON-1584194466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.311s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:24 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-8ce00f4d-af2f-408b-a1bc-1267c0a6b2fc tempest-VolumesListAdminTestJSON-1584194466 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:50:24 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-8ce00f4d-af2f-408b-a1bc-1267c0a6b2fc tempest-VolumesListAdminTestJSON-1584194466 None] Deleted volume successfully. Sep 16 17:50:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-665c89f1-b821-4ce4-b09f-36b82fd9aeaf tempest-VolumesListAdminTestJSON-1584194466 None] Acquiring lock "cinder-7eede1f4-a475-432f-bd58-00df8392915b-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8ce00f4d-af2f-408b-a1bc-1267c0a6b2fc tempest-VolumesListAdminTestJSON-1584194466 None] Lock "cinder-35169a69-4cb9-4b82-9e2f-a009c38d946f-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-665c89f1-b821-4ce4-b09f-36b82fd9aeaf tempest-VolumesListAdminTestJSON-1584194466 None] Lock "cinder-7eede1f4-a475-432f-bd58-00df8392915b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-665c89f1-b821-4ce4-b09f-36b82fd9aeaf tempest-VolumesListAdminTestJSON-1584194466 None] Acquiring lock "cinder-quobyte-7eede1f4-a475-432f-bd58-00df8392915b" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-665c89f1-b821-4ce4-b09f-36b82fd9aeaf tempest-VolumesListAdminTestJSON-1584194466 None] Lock "cinder-quobyte-7eede1f4-a475-432f-bd58-00df8392915b" acquired by "delete_volume" :: waited 0.023s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:24 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bf61ca-411f-4a50-82bd-7ea85067d14e]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:50:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-665c89f1-b821-4ce4-b09f-36b82fd9aeaf tempest-VolumesListAdminTestJSON-1584194466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7eede1f4-a475-432f-bd58-00df8392915b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b0abd08e-6ea1-4a48-8620-b05865cdb00e tempest-ProjectReaderTests-1091764089 None] Acquiring lock "cinder-e89afed6-3401-4efb-a5ed-d1f0ce4b08b2-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b0abd08e-6ea1-4a48-8620-b05865cdb00e tempest-ProjectReaderTests-1091764089 None] Lock "cinder-e89afed6-3401-4efb-a5ed-d1f0ce4b08b2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b0abd08e-6ea1-4a48-8620-b05865cdb00e tempest-ProjectReaderTests-1091764089 None] Acquiring lock "cinder-quobyte-e89afed6-3401-4efb-a5ed-d1f0ce4b08b2" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b0abd08e-6ea1-4a48-8620-b05865cdb00e tempest-ProjectReaderTests-1091764089 None] Lock "cinder-quobyte-e89afed6-3401-4efb-a5ed-d1f0ce4b08b2" acquired by "delete_volume" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:24 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7eede1f4-a475-432f-bd58-00df8392915b Sep 16 17:50:24 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:24 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bf70fc-acdd-4c16-b6ef-13198895354a]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:50:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b0abd08e-6ea1-4a48-8620-b05865cdb00e tempest-ProjectReaderTests-1091764089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e89afed6-3401-4efb-a5ed-d1f0ce4b08b2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:24 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e89afed6-3401-4efb-a5ed-d1f0ce4b08b2 Sep 16 17:50:24 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-4dc33950-f69a-4f32-a6c1-0d9a68a87f5c req-f29b9b50-a3d5-436d-adb9-f17f02729841 tempest-TestInstancesWithCinderVolumes-991321737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-4dc33950-f69a-4f32-a6c1-0d9a68a87f5c req-f29b9b50-a3d5-436d-adb9-f17f02729841 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-4dc33950-f69a-4f32-a6c1-0d9a68a87f5c req-f29b9b50-a3d5-436d-adb9-f17f02729841 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:24 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-665c89f1-b821-4ce4-b09f-36b82fd9aeaf tempest-VolumesListAdminTestJSON-1584194466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7eede1f4-a475-432f-bd58-00df8392915b" returned: 0 in 0.452s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-665c89f1-b821-4ce4-b09f-36b82fd9aeaf tempest-VolumesListAdminTestJSON-1584194466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7eede1f4-a475-432f-bd58-00df8392915b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:24 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7eede1f4-a475-432f-bd58-00df8392915b Sep 16 17:50:24 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-4dc33950-f69a-4f32-a6c1-0d9a68a87f5c req-f29b9b50-a3d5-436d-adb9-f17f02729841 tempest-TestInstancesWithCinderVolumes-991321737 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7', 'name': 'volume-58169307-2909-4356-b97f-2a20894058dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '203e312a-cda9-4905-bdb9-d0a8c33ddda2', 'enforce_multipath': True} {{(pid=85899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4920}} Sep 16 17:50:24 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-4dc33950-f69a-4f32-a6c1-0d9a68a87f5c req-f29b9b50-a3d5-436d-adb9-f17f02729841 tempest-TestInstancesWithCinderVolumes-991321737 None] attachment_update completed successfully. Sep 16 17:50:24 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b0abd08e-6ea1-4a48-8620-b05865cdb00e tempest-ProjectReaderTests-1091764089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e89afed6-3401-4efb-a5ed-d1f0ce4b08b2" returned: 0 in 0.431s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b0abd08e-6ea1-4a48-8620-b05865cdb00e tempest-ProjectReaderTests-1091764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e89afed6-3401-4efb-a5ed-d1f0ce4b08b2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:24 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e89afed6-3401-4efb-a5ed-d1f0ce4b08b2 Sep 16 17:50:24 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:25 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-665c89f1-b821-4ce4-b09f-36b82fd9aeaf tempest-VolumesListAdminTestJSON-1584194466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7eede1f4-a475-432f-bd58-00df8392915b" returned: 0 in 0.291s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-665c89f1-b821-4ce4-b09f-36b82fd9aeaf tempest-VolumesListAdminTestJSON-1584194466 None] Lock "cinder-quobyte-7eede1f4-a475-432f-bd58-00df8392915b" released by "delete_volume" :: held 0.799s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-665c89f1-b821-4ce4-b09f-36b82fd9aeaf tempest-VolumesListAdminTestJSON-1584194466 None] Created reservations ['2883aa63-da7e-495a-bd8b-aabf637579eb', '372940af-f525-4f71-a6f3-b85b3ca1d541', '3f669c7a-7c0d-4894-b8a8-ab12ed0fbc56', '5cd4ed23-091e-46aa-bc22-74859023984b'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-665c89f1-b821-4ce4-b09f-36b82fd9aeaf tempest-VolumesListAdminTestJSON-1584194466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-665c89f1-b821-4ce4-b09f-36b82fd9aeaf tempest-VolumesListAdminTestJSON-1584194466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-665c89f1-b821-4ce4-b09f-36b82fd9aeaf tempest-VolumesListAdminTestJSON-1584194466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-665c89f1-b821-4ce4-b09f-36b82fd9aeaf tempest-VolumesListAdminTestJSON-1584194466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-665c89f1-b821-4ce4-b09f-36b82fd9aeaf tempest-VolumesListAdminTestJSON-1584194466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-665c89f1-b821-4ce4-b09f-36b82fd9aeaf tempest-VolumesListAdminTestJSON-1584194466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:25 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b0abd08e-6ea1-4a48-8620-b05865cdb00e tempest-ProjectReaderTests-1091764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e89afed6-3401-4efb-a5ed-d1f0ce4b08b2" returned: 0 in 0.333s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:25 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:50:25 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b0abd08e-6ea1-4a48-8620-b05865cdb00e tempest-ProjectReaderTests-1091764089 None] Lock "cinder-quobyte-e89afed6-3401-4efb-a5ed-d1f0ce4b08b2" released by "delete_volume" :: held 0.849s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-b0abd08e-6ea1-4a48-8620-b05865cdb00e tempest-ProjectReaderTests-1091764089 None] Created reservations ['d9bae4ec-a6c6-4ac5-9ef7-d58e4575fda9', 'd59a15a7-4522-43fe-bb5f-2a68a0b71945', 'baa56ad7-671c-476a-ba27-3418084c5ba6', '880a5f1c-876c-49d7-9658-0def8b1041d5'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b0abd08e-6ea1-4a48-8620-b05865cdb00e tempest-ProjectReaderTests-1091764089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b0abd08e-6ea1-4a48-8620-b05865cdb00e tempest-ProjectReaderTests-1091764089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b0abd08e-6ea1-4a48-8620-b05865cdb00e tempest-ProjectReaderTests-1091764089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b0abd08e-6ea1-4a48-8620-b05865cdb00e tempest-ProjectReaderTests-1091764089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b0abd08e-6ea1-4a48-8620-b05865cdb00e tempest-ProjectReaderTests-1091764089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b0abd08e-6ea1-4a48-8620-b05865cdb00e tempest-ProjectReaderTests-1091764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:25 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:50:25 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:25 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-665c89f1-b821-4ce4-b09f-36b82fd9aeaf tempest-VolumesListAdminTestJSON-1584194466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.393s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-665c89f1-b821-4ce4-b09f-36b82fd9aeaf tempest-VolumesListAdminTestJSON-1584194466 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:50:25 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-665c89f1-b821-4ce4-b09f-36b82fd9aeaf tempest-VolumesListAdminTestJSON-1584194466 None] Deleted volume successfully. Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-665c89f1-b821-4ce4-b09f-36b82fd9aeaf tempest-VolumesListAdminTestJSON-1584194466 None] Lock "cinder-7eede1f4-a475-432f-bd58-00df8392915b-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:25 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b0abd08e-6ea1-4a48-8620-b05865cdb00e tempest-ProjectReaderTests-1091764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.351s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b0abd08e-6ea1-4a48-8620-b05865cdb00e tempest-ProjectReaderTests-1091764089 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:50:25 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-b0abd08e-6ea1-4a48-8620-b05865cdb00e tempest-ProjectReaderTests-1091764089 None] Deleted volume successfully. Sep 16 17:50:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b0abd08e-6ea1-4a48-8620-b05865cdb00e tempest-ProjectReaderTests-1091764089 None] Lock "cinder-e89afed6-3401-4efb-a5ed-d1f0ce4b08b2-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Flow 'volume_create_manager' (b2607cc6-18f2-43a6-b653-84fa9191b1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af97cf10-329f-44f5-958a-dd75bf7ffb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af97cf10-329f-44f5-958a-dd75bf7ffb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-394229141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1dfff02-edb8-4fc9-a010-4e9ca2260ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291cb04fcbd64af39d3076fdaa57a733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:50:26Z,use_quota=True,user_id='dd1d9aa092884363a64f0a27228c866a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (958e7249-22a1-4ba0-a856-75ffa363d8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (958e7249-22a1-4ba0-a856-75ffa363d8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f5dca2f-9a18-49d4-9060-288b02549c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f5dca2f-9a18-49d4-9060-288b02549c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1dfff02-edb8-4fc9-a010-4e9ca2260ecf', 'volume_name': 'volume-f1dfff02-edb8-4fc9-a010-4e9ca2260ecf', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da48605-2d85-4faa-9af6-ab0e67cb83bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da48605-2d85-4faa-9af6-ab0e67cb83bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d110ced-4b2d-4e5d-85fe-0dbfe48121aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:26 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Volume f1dfff02-edb8-4fc9-a010-4e9ca2260ecf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1dfff02-edb8-4fc9-a010-4e9ca2260ecf', 'volume_size': 1} Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-394229141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1dfff02-edb8-4fc9-a010-4e9ca2260ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291cb04fcbd64af39d3076fdaa57a733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:50:26Z,use_quota=True,user_id='dd1d9aa092884363a64f0a27228c866a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Creating volume f1dfff02-edb8-4fc9-a010-4e9ca2260ecf {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:50:26 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f1dfff02-edb8-4fc9-a010-4e9ca2260ecf 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:26 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f1dfff02-edb8-4fc9-a010-4e9ca2260ecf 1073741824 Sep 16 17:50:26 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:26 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f1dfff02-edb8-4fc9-a010-4e9ca2260ecf 1073741824" returned: 0 in 0.536s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f1dfff02-edb8-4fc9-a010-4e9ca2260ecf {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:27 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f1dfff02-edb8-4fc9-a010-4e9ca2260ecf Sep 16 17:50:27 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:27 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f1dfff02-edb8-4fc9-a010-4e9ca2260ecf" returned: 0 in 0.370s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:27 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:50:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d110ced-4b2d-4e5d-85fe-0dbfe48121aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1dfff02-edb8-4fc9-a010-4e9ca2260ecf', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0f9ee3-45b2-4b34-91b8-be14ad2f3f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:27 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Volume volume-f1dfff02-edb8-4fc9-a010-4e9ca2260ecf (f1dfff02-edb8-4fc9-a010-4e9ca2260ecf): created successfully Sep 16 17:50:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0f9ee3-45b2-4b34-91b8-be14ad2f3f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Flow 'volume_create_manager' (b2607cc6-18f2-43a6-b653-84fa9191b1d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:50:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-c47d04bf-4eb3-4e32-b665-fd5d08b6c932 req-6fc1fceb-b902-49c8-9e16-a4856cca3ee2 tempest-TestInstancesWithCinderVolumes-991321737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-c47d04bf-4eb3-4e32-b665-fd5d08b6c932 req-6fc1fceb-b902-49c8-9e16-a4856cca3ee2 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:27 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-7bd058cd-0b1d-4027-9186-7461233a575e tempest-ProjectReaderTests-1091764089 None] Created volume successfully. Sep 16 17:50:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-c47d04bf-4eb3-4e32-b665-fd5d08b6c932 req-6fc1fceb-b902-49c8-9e16-a4856cca3ee2 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-c47d04bf-4eb3-4e32-b665-fd5d08b6c932 req-6fc1fceb-b902-49c8-9e16-a4856cca3ee2 tempest-TestInstancesWithCinderVolumes-991321737 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7', 'name': 'volume-d877794a-fcca-4fc0-9363-3ef36a113e9a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0227d899-cf99-489a-9cc9-f13c554bdf2c', 'enforce_multipath': True} {{(pid=85899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4920}} Sep 16 17:50:27 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-c47d04bf-4eb3-4e32-b665-fd5d08b6c932 req-6fc1fceb-b902-49c8-9e16-a4856cca3ee2 tempest-TestInstancesWithCinderVolumes-991321737 None] attachment_update completed successfully. Sep 16 17:50:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0895ab03-1387-4c35-b4fb-ebb790342741 tempest-ProjectReaderTests-1091764089 None] Acquiring lock "cinder-f1dfff02-edb8-4fc9-a010-4e9ca2260ecf-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0895ab03-1387-4c35-b4fb-ebb790342741 tempest-ProjectReaderTests-1091764089 None] Lock "cinder-f1dfff02-edb8-4fc9-a010-4e9ca2260ecf-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0895ab03-1387-4c35-b4fb-ebb790342741 tempest-ProjectReaderTests-1091764089 None] Acquiring lock "cinder-quobyte-f1dfff02-edb8-4fc9-a010-4e9ca2260ecf" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0895ab03-1387-4c35-b4fb-ebb790342741 tempest-ProjectReaderTests-1091764089 None] Lock "cinder-quobyte-f1dfff02-edb8-4fc9-a010-4e9ca2260ecf" acquired by "delete_volume" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:28 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5b3ea5-40f4-46cb-aad9-c16a3af153ba]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:50:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0895ab03-1387-4c35-b4fb-ebb790342741 tempest-ProjectReaderTests-1091764089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f1dfff02-edb8-4fc9-a010-4e9ca2260ecf {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:28 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f1dfff02-edb8-4fc9-a010-4e9ca2260ecf Sep 16 17:50:28 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:29 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0895ab03-1387-4c35-b4fb-ebb790342741 tempest-ProjectReaderTests-1091764089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f1dfff02-edb8-4fc9-a010-4e9ca2260ecf" returned: 0 in 0.483s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0895ab03-1387-4c35-b4fb-ebb790342741 tempest-ProjectReaderTests-1091764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f1dfff02-edb8-4fc9-a010-4e9ca2260ecf {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:29 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f1dfff02-edb8-4fc9-a010-4e9ca2260ecf Sep 16 17:50:29 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:29 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0895ab03-1387-4c35-b4fb-ebb790342741 tempest-ProjectReaderTests-1091764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f1dfff02-edb8-4fc9-a010-4e9ca2260ecf" returned: 0 in 0.305s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:29 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0895ab03-1387-4c35-b4fb-ebb790342741 tempest-ProjectReaderTests-1091764089 None] Lock "cinder-quobyte-f1dfff02-edb8-4fc9-a010-4e9ca2260ecf" released by "delete_volume" :: held 0.850s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:29 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-0895ab03-1387-4c35-b4fb-ebb790342741 tempest-ProjectReaderTests-1091764089 None] Created reservations ['eb640ad5-af64-4481-8ea9-6cc13bb3eb93', 'f073894e-6af2-4600-9abe-075bc2910d1a', 'a0857b5b-4e08-4021-afb5-4770c6de8be3', '08346e88-435d-4cc0-bff4-a1464377387f'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:50:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0895ab03-1387-4c35-b4fb-ebb790342741 tempest-ProjectReaderTests-1091764089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0895ab03-1387-4c35-b4fb-ebb790342741 tempest-ProjectReaderTests-1091764089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0895ab03-1387-4c35-b4fb-ebb790342741 tempest-ProjectReaderTests-1091764089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0895ab03-1387-4c35-b4fb-ebb790342741 tempest-ProjectReaderTests-1091764089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0895ab03-1387-4c35-b4fb-ebb790342741 tempest-ProjectReaderTests-1091764089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0895ab03-1387-4c35-b4fb-ebb790342741 tempest-ProjectReaderTests-1091764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:29 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:50:29 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:29 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0895ab03-1387-4c35-b4fb-ebb790342741 tempest-ProjectReaderTests-1091764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.351s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:29 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-0895ab03-1387-4c35-b4fb-ebb790342741 tempest-ProjectReaderTests-1091764089 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:50:29 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-0895ab03-1387-4c35-b4fb-ebb790342741 tempest-ProjectReaderTests-1091764089 None] Deleted volume successfully. Sep 16 17:50:29 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0895ab03-1387-4c35-b4fb-ebb790342741 tempest-ProjectReaderTests-1091764089 None] Lock "cinder-f1dfff02-edb8-4fc9-a010-4e9ca2260ecf-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:32 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-1e8c3b5b-a754-4b3c-b4f3-b78295ee39f7 req-e970a901-a417-4c31-ac07-5836cfdade41 tempest-TestInstancesWithCinderVolumes-991321737 None] Terminate volume connection completed successfully. Sep 16 17:50:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-1e8c3b5b-a754-4b3c-b4f3-b78295ee39f7 req-e970a901-a417-4c31-ac07-5836cfdade41 tempest-TestInstancesWithCinderVolumes-991321737 None] Deleting attachment 203e312a-cda9-4905-bdb9-d0a8c33ddda2. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:50:33 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d5904611-3b9e-4abf-a8e8-63d019799179 tempest-TestInstancesWithCinderVolumes-991321737 None] Acquiring lock "cinder-58169307-2909-4356-b97f-2a20894058dd-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:33 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d5904611-3b9e-4abf-a8e8-63d019799179 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "cinder-58169307-2909-4356-b97f-2a20894058dd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:33 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d5904611-3b9e-4abf-a8e8-63d019799179 tempest-TestInstancesWithCinderVolumes-991321737 None] Acquiring lock "cinder-quobyte-58169307-2909-4356-b97f-2a20894058dd" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:33 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d5904611-3b9e-4abf-a8e8-63d019799179 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "cinder-quobyte-58169307-2909-4356-b97f-2a20894058dd" acquired by "delete_volume" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:33 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd69772-0339-48e0-80ed-4ce67cfb3411]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:50:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d5904611-3b9e-4abf-a8e8-63d019799179 tempest-TestInstancesWithCinderVolumes-991321737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-58169307-2909-4356-b97f-2a20894058dd {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:33 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-58169307-2909-4356-b97f-2a20894058dd Sep 16 17:50:33 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:34 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d5904611-3b9e-4abf-a8e8-63d019799179 tempest-TestInstancesWithCinderVolumes-991321737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-58169307-2909-4356-b97f-2a20894058dd" returned: 0 in 0.422s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d5904611-3b9e-4abf-a8e8-63d019799179 tempest-TestInstancesWithCinderVolumes-991321737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-58169307-2909-4356-b97f-2a20894058dd {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:34 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-58169307-2909-4356-b97f-2a20894058dd Sep 16 17:50:34 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:34 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d5904611-3b9e-4abf-a8e8-63d019799179 tempest-TestInstancesWithCinderVolumes-991321737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-58169307-2909-4356-b97f-2a20894058dd" returned: 0 in 0.271s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d5904611-3b9e-4abf-a8e8-63d019799179 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "cinder-quobyte-58169307-2909-4356-b97f-2a20894058dd" released by "delete_volume" :: held 0.764s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:34 devstack cinder-volume[85899]: WARNING cinder.quota [None req-d5904611-3b9e-4abf-a8e8-63d019799179 tempest-TestInstancesWithCinderVolumes-991321737 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-756128124-1391709769 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-756128124-1391709769, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:50:34 devstack cinder-volume[85899]: WARNING cinder.quota [None req-d5904611-3b9e-4abf-a8e8-63d019799179 tempest-TestInstancesWithCinderVolumes-991321737 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-756128124-1391709769 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-756128124-1391709769, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:50:34 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-d5904611-3b9e-4abf-a8e8-63d019799179 tempest-TestInstancesWithCinderVolumes-991321737 None] Created reservations ['b645ff83-d7d9-4611-85cc-9e79e98d73a9', '4a70d96f-b33f-49d6-aab7-bed7ad778a70', '4d9ba99d-0eff-4f3b-b83f-88cdb4f6c518', '7dab5f10-f7a7-49bd-9d07-0f89593afd4b'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:50:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d5904611-3b9e-4abf-a8e8-63d019799179 tempest-TestInstancesWithCinderVolumes-991321737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d5904611-3b9e-4abf-a8e8-63d019799179 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d5904611-3b9e-4abf-a8e8-63d019799179 tempest-TestInstancesWithCinderVolumes-991321737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d5904611-3b9e-4abf-a8e8-63d019799179 tempest-TestInstancesWithCinderVolumes-991321737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d5904611-3b9e-4abf-a8e8-63d019799179 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d5904611-3b9e-4abf-a8e8-63d019799179 tempest-TestInstancesWithCinderVolumes-991321737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:34 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:50:34 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:34 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d5904611-3b9e-4abf-a8e8-63d019799179 tempest-TestInstancesWithCinderVolumes-991321737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.276s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:34 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-d5904611-3b9e-4abf-a8e8-63d019799179 tempest-TestInstancesWithCinderVolumes-991321737 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:50:34 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-d5904611-3b9e-4abf-a8e8-63d019799179 tempest-TestInstancesWithCinderVolumes-991321737 None] Deleted volume successfully. Sep 16 17:50:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d5904611-3b9e-4abf-a8e8-63d019799179 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "cinder-58169307-2909-4356-b97f-2a20894058dd-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Flow 'volume_create_manager' (154b9e84-b8eb-4114-9d0a-7ff902989ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e31740a-ee66-41ea-a177-b652dee29b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e31740a-ee66-41ea-a177-b652dee29b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2119498184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697ee821-469d-4530-9837-da3698676842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a77a63c72b144e99e26d0672f143c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:50:35Z,use_quota=True,user_id='8e62157e81f94184afdb0378938bb1fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfe8a39-e62a-4dd9-a5d3-0d4c379f55a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfe8a39-e62a-4dd9-a5d3-0d4c379f55a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ee744a-e0c1-4e90-8a40-a74aaa56ac94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ee744a-e0c1-4e90-8a40-a74aaa56ac94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '697ee821-469d-4530-9837-da3698676842', 'volume_name': 'volume-697ee821-469d-4530-9837-da3698676842', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd508e46-1b91-4dcc-94b4-728760dc9b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd508e46-1b91-4dcc-94b4-728760dc9b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb473ef2-5af7-4818-8043-a215c5036a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:35 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Volume 697ee821-469d-4530-9837-da3698676842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-697ee821-469d-4530-9837-da3698676842', 'volume_size': 1} Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2119498184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697ee821-469d-4530-9837-da3698676842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a77a63c72b144e99e26d0672f143c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:50:35Z,use_quota=True,user_id='8e62157e81f94184afdb0378938bb1fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Creating volume 697ee821-469d-4530-9837-da3698676842 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:50:35 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:35 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842 1073741824 Sep 16 17:50:35 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:35 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842 1073741824" returned: 0 in 0.504s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:35 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842 Sep 16 17:50:35 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:36 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842" returned: 0 in 0.255s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:36 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:50:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb473ef2-5af7-4818-8043-a215c5036a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-697ee821-469d-4530-9837-da3698676842', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deef8cfb-f184-44c7-b568-1c19b78f10cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:36 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Volume volume-697ee821-469d-4530-9837-da3698676842 (697ee821-469d-4530-9837-da3698676842): created successfully Sep 16 17:50:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deef8cfb-f184-44c7-b568-1c19b78f10cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Flow 'volume_create_manager' (154b9e84-b8eb-4114-9d0a-7ff902989ab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:50:36 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-9a6ada55-9755-4567-a1b4-37f997f420b2 tempest-SnapshotMetadataTestJSON-1444078529 None] Created volume successfully. Sep 16 17:50:37 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-d30a0f54-7e29-481d-8c69-80f6e98c8678 req-48388fae-7740-4874-9270-ade185d9ec28 tempest-TestInstancesWithCinderVolumes-991321737 None] Terminate volume connection completed successfully. Sep 16 17:50:37 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-d30a0f54-7e29-481d-8c69-80f6e98c8678 req-48388fae-7740-4874-9270-ade185d9ec28 tempest-TestInstancesWithCinderVolumes-991321737 None] Deleting attachment 0227d899-cf99-489a-9cc9-f13c554bdf2c. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:50:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6db01c2a-d152-4105-989d-370e2f16c272 tempest-SnapshotMetadataTestJSON-1444078529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6db01c2a-d152-4105-989d-370e2f16c272 tempest-SnapshotMetadataTestJSON-1444078529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:37 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-6db01c2a-d152-4105-989d-370e2f16c272 tempest-SnapshotMetadataTestJSON-1444078529 None] Creating offline snapshot 1f5fa078-6adb-4d38-a054-882b82bae193 of volume 697ee821-469d-4530-9837-da3698676842 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:50:37 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[119320a0-40c2-4897-bbff-1f898cb306e3]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:50:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6db01c2a-d152-4105-989d-370e2f16c272 tempest-SnapshotMetadataTestJSON-1444078529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:37 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842 Sep 16 17:50:37 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:37 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6db01c2a-d152-4105-989d-370e2f16c272 tempest-SnapshotMetadataTestJSON-1444078529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842" returned: 0 in 0.369s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6db01c2a-d152-4105-989d-370e2f16c272 tempest-SnapshotMetadataTestJSON-1444078529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.1f5fa078-6adb-4d38-a054-882b82bae193 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:38 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.1f5fa078-6adb-4d38-a054-882b82bae193 1G Sep 16 17:50:38 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-68747e42-ee19-4623-af8d-34a475ad45c0 tempest-TestInstancesWithCinderVolumes-991321737 None] Acquiring lock "cinder-d877794a-fcca-4fc0-9363-3ef36a113e9a-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-68747e42-ee19-4623-af8d-34a475ad45c0 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "cinder-d877794a-fcca-4fc0-9363-3ef36a113e9a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-68747e42-ee19-4623-af8d-34a475ad45c0 tempest-TestInstancesWithCinderVolumes-991321737 None] Acquiring lock "cinder-quobyte-d877794a-fcca-4fc0-9363-3ef36a113e9a" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-68747e42-ee19-4623-af8d-34a475ad45c0 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "cinder-quobyte-d877794a-fcca-4fc0-9363-3ef36a113e9a" acquired by "delete_volume" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:38 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0eb189c-13c4-405a-9302-ba0484192fc6]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:50:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-68747e42-ee19-4623-af8d-34a475ad45c0 tempest-TestInstancesWithCinderVolumes-991321737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d877794a-fcca-4fc0-9363-3ef36a113e9a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:38 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d877794a-fcca-4fc0-9363-3ef36a113e9a Sep 16 17:50:38 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:38 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6db01c2a-d152-4105-989d-370e2f16c272 tempest-SnapshotMetadataTestJSON-1444078529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.1f5fa078-6adb-4d38-a054-882b82bae193 1G" returned: 0 in 0.513s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6db01c2a-d152-4105-989d-370e2f16c272 tempest-SnapshotMetadataTestJSON-1444078529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-697ee821-469d-4530-9837-da3698676842 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.1f5fa078-6adb-4d38-a054-882b82bae193 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:38 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-697ee821-469d-4530-9837-da3698676842 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.1f5fa078-6adb-4d38-a054-882b82bae193 Sep 16 17:50:38 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:38 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-68747e42-ee19-4623-af8d-34a475ad45c0 tempest-TestInstancesWithCinderVolumes-991321737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d877794a-fcca-4fc0-9363-3ef36a113e9a" returned: 0 in 0.416s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-68747e42-ee19-4623-af8d-34a475ad45c0 tempest-TestInstancesWithCinderVolumes-991321737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d877794a-fcca-4fc0-9363-3ef36a113e9a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:38 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d877794a-fcca-4fc0-9363-3ef36a113e9a Sep 16 17:50:38 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:38 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6db01c2a-d152-4105-989d-370e2f16c272 tempest-SnapshotMetadataTestJSON-1444078529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-697ee821-469d-4530-9837-da3698676842 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.1f5fa078-6adb-4d38-a054-882b82bae193" returned: 0 in 0.331s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:38 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-6db01c2a-d152-4105-989d-370e2f16c272 tempest-SnapshotMetadataTestJSON-1444078529 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.1f5fa078-6adb-4d38-a054-882b82bae193 is being set with open permissions: ugo+rw Sep 16 17:50:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6db01c2a-d152-4105-989d-370e2f16c272 tempest-SnapshotMetadataTestJSON-1444078529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.1f5fa078-6adb-4d38-a054-882b82bae193 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:38 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.1f5fa078-6adb-4d38-a054-882b82bae193 Sep 16 17:50:38 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:38 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-68747e42-ee19-4623-af8d-34a475ad45c0 tempest-TestInstancesWithCinderVolumes-991321737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d877794a-fcca-4fc0-9363-3ef36a113e9a" returned: 0 in 0.290s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-68747e42-ee19-4623-af8d-34a475ad45c0 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "cinder-quobyte-d877794a-fcca-4fc0-9363-3ef36a113e9a" released by "delete_volume" :: held 0.758s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:39 devstack cinder-volume[85899]: WARNING cinder.quota [None req-68747e42-ee19-4623-af8d-34a475ad45c0 tempest-TestInstancesWithCinderVolumes-991321737 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-71860805-2109670044 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-71860805-2109670044, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:50:39 devstack cinder-volume[85899]: WARNING cinder.quota [None req-68747e42-ee19-4623-af8d-34a475ad45c0 tempest-TestInstancesWithCinderVolumes-991321737 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-71860805-2109670044 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-71860805-2109670044, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:50:39 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-68747e42-ee19-4623-af8d-34a475ad45c0 tempest-TestInstancesWithCinderVolumes-991321737 None] Created reservations ['285058f3-4766-4244-b0f2-2645a86d65c6', '5517f94a-4662-424c-92ae-fc819e61ee2c', '7c02e6c5-8448-4e79-9d51-7da2ce36f852', '381092cc-3cf6-4b73-b231-fa002f130b2d'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:50:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-68747e42-ee19-4623-af8d-34a475ad45c0 tempest-TestInstancesWithCinderVolumes-991321737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-68747e42-ee19-4623-af8d-34a475ad45c0 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-68747e42-ee19-4623-af8d-34a475ad45c0 tempest-TestInstancesWithCinderVolumes-991321737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-68747e42-ee19-4623-af8d-34a475ad45c0 tempest-TestInstancesWithCinderVolumes-991321737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-68747e42-ee19-4623-af8d-34a475ad45c0 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-68747e42-ee19-4623-af8d-34a475ad45c0 tempest-TestInstancesWithCinderVolumes-991321737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:39 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:50:39 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:39 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6db01c2a-d152-4105-989d-370e2f16c272 tempest-SnapshotMetadataTestJSON-1444078529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.1f5fa078-6adb-4d38-a054-882b82bae193" returned: 0 in 0.327s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6db01c2a-d152-4105-989d-370e2f16c272 tempest-SnapshotMetadataTestJSON-1444078529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:39 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.info Sep 16 17:50:39 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:39 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-68747e42-ee19-4623-af8d-34a475ad45c0 tempest-TestInstancesWithCinderVolumes-991321737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.278s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:39 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-68747e42-ee19-4623-af8d-34a475ad45c0 tempest-TestInstancesWithCinderVolumes-991321737 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:50:39 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-68747e42-ee19-4623-af8d-34a475ad45c0 tempest-TestInstancesWithCinderVolumes-991321737 None] Deleted volume successfully. Sep 16 17:50:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-68747e42-ee19-4623-af8d-34a475ad45c0 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "cinder-d877794a-fcca-4fc0-9363-3ef36a113e9a-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:39 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6db01c2a-d152-4105-989d-370e2f16c272 tempest-SnapshotMetadataTestJSON-1444078529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.info" returned: 0 in 0.281s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:39 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-6db01c2a-d152-4105-989d-370e2f16c272 tempest-SnapshotMetadataTestJSON-1444078529 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.info is being set with open permissions: ugo+rw Sep 16 17:50:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6db01c2a-d152-4105-989d-370e2f16c272 tempest-SnapshotMetadataTestJSON-1444078529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:39 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.info Sep 16 17:50:39 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:39 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6db01c2a-d152-4105-989d-370e2f16c272 tempest-SnapshotMetadataTestJSON-1444078529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.info" returned: 0 in 0.309s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6db01c2a-d152-4105-989d-370e2f16c272 tempest-SnapshotMetadataTestJSON-1444078529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.262s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:39 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-6db01c2a-d152-4105-989d-370e2f16c272 tempest-SnapshotMetadataTestJSON-1444078529 None] Create snapshot completed successfully Sep 16 17:50:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8bf99e2f-7839-4c7c-a053-34807a41fd19 tempest-SnapshotMetadataTestJSON-1444078529 None] Acquiring lock "cinder-1f5fa078-6adb-4d38-a054-882b82bae193-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8bf99e2f-7839-4c7c-a053-34807a41fd19 tempest-SnapshotMetadataTestJSON-1444078529 None] Lock "cinder-1f5fa078-6adb-4d38-a054-882b82bae193-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8bf99e2f-7839-4c7c-a053-34807a41fd19 tempest-SnapshotMetadataTestJSON-1444078529 None] Acquiring lock "cinder-quobyte-697ee821-469d-4530-9837-da3698676842" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8bf99e2f-7839-4c7c-a053-34807a41fd19 tempest-SnapshotMetadataTestJSON-1444078529 None] Lock "cinder-quobyte-697ee821-469d-4530-9837-da3698676842" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8bf99e2f-7839-4c7c-a053-34807a41fd19 tempest-SnapshotMetadataTestJSON-1444078529 None] Acquiring lock "cinder-quobyte-1f5fa078-6adb-4d38-a054-882b82bae193" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8bf99e2f-7839-4c7c-a053-34807a41fd19 tempest-SnapshotMetadataTestJSON-1444078529 None] Lock "cinder-quobyte-1f5fa078-6adb-4d38-a054-882b82bae193" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-8bf99e2f-7839-4c7c-a053-34807a41fd19 tempest-SnapshotMetadataTestJSON-1444078529 None] Deleting offline snapshot 1f5fa078-6adb-4d38-a054-882b82bae193 of volume 697ee821-469d-4530-9837-da3698676842 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:50:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-8bf99e2f-7839-4c7c-a053-34807a41fd19 tempest-SnapshotMetadataTestJSON-1444078529 None] snapshot_file for this snap is: volume-697ee821-469d-4530-9837-da3698676842.1f5fa078-6adb-4d38-a054-882b82bae193 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:50:42 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3635fd2f-bf9a-464c-b440-3da7bf8187bd]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:50:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8bf99e2f-7839-4c7c-a053-34807a41fd19 tempest-SnapshotMetadataTestJSON-1444078529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.1f5fa078-6adb-4d38-a054-882b82bae193 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:42 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.1f5fa078-6adb-4d38-a054-882b82bae193 Sep 16 17:50:42 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:42 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-34bb59cd-8234-44a6-af2b-40750cc7c821 req-9511b431-878f-410a-8cb6-17ce43bf2822 tempest-TestInstancesWithCinderVolumes-991321737 None] Terminate volume connection completed successfully. Sep 16 17:50:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-34bb59cd-8234-44a6-af2b-40750cc7c821 req-9511b431-878f-410a-8cb6-17ce43bf2822 tempest-TestInstancesWithCinderVolumes-991321737 None] Deleting attachment c4c80e45-415e-4c66-83ed-ea0cd6962a63. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:50:42 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8bf99e2f-7839-4c7c-a053-34807a41fd19 tempest-SnapshotMetadataTestJSON-1444078529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.1f5fa078-6adb-4d38-a054-882b82bae193" returned: 0 in 0.462s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-8bf99e2f-7839-4c7c-a053-34807a41fd19 tempest-SnapshotMetadataTestJSON-1444078529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-697ee821-469d-4530-9837-da3698676842(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:50:42 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[965743ae-c9aa-4d90-96a1-b6a643b3cdad]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:50:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8bf99e2f-7839-4c7c-a053-34807a41fd19 tempest-SnapshotMetadataTestJSON-1444078529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:42 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842 Sep 16 17:50:42 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:42 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8bf99e2f-7839-4c7c-a053-34807a41fd19 tempest-SnapshotMetadataTestJSON-1444078529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842" returned: 0 in 0.392s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8bf99e2f-7839-4c7c-a053-34807a41fd19 tempest-SnapshotMetadataTestJSON-1444078529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.1f5fa078-6adb-4d38-a054-882b82bae193 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:43 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.1f5fa078-6adb-4d38-a054-882b82bae193 Sep 16 17:50:43 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:43 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8bf99e2f-7839-4c7c-a053-34807a41fd19 tempest-SnapshotMetadataTestJSON-1444078529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.1f5fa078-6adb-4d38-a054-882b82bae193" returned: 0 in 0.328s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8bf99e2f-7839-4c7c-a053-34807a41fd19 tempest-SnapshotMetadataTestJSON-1444078529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.1f5fa078-6adb-4d38-a054-882b82bae193 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:43 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.1f5fa078-6adb-4d38-a054-882b82bae193 Sep 16 17:50:43 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d3e248c9-cb66-434f-8f1f-361651a3f8f8 tempest-TestInstancesWithCinderVolumes-991321737 None] Acquiring lock "cinder-167a5d07-ba57-4afe-a015-ff20e0e50328-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d3e248c9-cb66-434f-8f1f-361651a3f8f8 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "cinder-167a5d07-ba57-4afe-a015-ff20e0e50328-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d3e248c9-cb66-434f-8f1f-361651a3f8f8 tempest-TestInstancesWithCinderVolumes-991321737 None] Acquiring lock "cinder-quobyte-167a5d07-ba57-4afe-a015-ff20e0e50328" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d3e248c9-cb66-434f-8f1f-361651a3f8f8 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "cinder-quobyte-167a5d07-ba57-4afe-a015-ff20e0e50328" acquired by "delete_volume" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:43 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[188f56b2-b8c2-4f80-8694-3d4fd72f3def]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:50:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d3e248c9-cb66-434f-8f1f-361651a3f8f8 tempest-TestInstancesWithCinderVolumes-991321737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-167a5d07-ba57-4afe-a015-ff20e0e50328 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:43 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8bf99e2f-7839-4c7c-a053-34807a41fd19 tempest-SnapshotMetadataTestJSON-1444078529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842.1f5fa078-6adb-4d38-a054-882b82bae193" returned: 0 in 0.258s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8bf99e2f-7839-4c7c-a053-34807a41fd19 tempest-SnapshotMetadataTestJSON-1444078529 None] Lock "cinder-quobyte-1f5fa078-6adb-4d38-a054-882b82bae193" released by "_delete_snapshot" :: held 1.612s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:43 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-167a5d07-ba57-4afe-a015-ff20e0e50328 Sep 16 17:50:43 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8bf99e2f-7839-4c7c-a053-34807a41fd19 tempest-SnapshotMetadataTestJSON-1444078529 None] Lock "cinder-quobyte-697ee821-469d-4530-9837-da3698676842" released by "delete_snapshot" :: held 1.644s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:43 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-8bf99e2f-7839-4c7c-a053-34807a41fd19 tempest-SnapshotMetadataTestJSON-1444078529 None] Created reservations ['230a33a4-61a3-4a0e-b3f4-317f4cff39ac', '5b6760cc-082d-4a5b-9826-9a29045e1fe0', '30eb155e-8eff-4f5d-b654-f365de04e1eb', 'f5db69db-be35-4ab5-92c3-64a51ff02e87'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:50:43 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-8bf99e2f-7839-4c7c-a053-34807a41fd19 tempest-SnapshotMetadataTestJSON-1444078529 None] Delete snapshot completed successfully. Sep 16 17:50:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8bf99e2f-7839-4c7c-a053-34807a41fd19 tempest-SnapshotMetadataTestJSON-1444078529 None] Lock "cinder-1f5fa078-6adb-4d38-a054-882b82bae193-delete_snapshot" released by "delete_snapshot" :: held 1.800s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:43 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d3e248c9-cb66-434f-8f1f-361651a3f8f8 tempest-TestInstancesWithCinderVolumes-991321737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-167a5d07-ba57-4afe-a015-ff20e0e50328" returned: 0 in 0.394s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d3e248c9-cb66-434f-8f1f-361651a3f8f8 tempest-TestInstancesWithCinderVolumes-991321737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-167a5d07-ba57-4afe-a015-ff20e0e50328 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:43 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-167a5d07-ba57-4afe-a015-ff20e0e50328 Sep 16 17:50:43 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:44 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d3e248c9-cb66-434f-8f1f-361651a3f8f8 tempest-TestInstancesWithCinderVolumes-991321737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-167a5d07-ba57-4afe-a015-ff20e0e50328" returned: 0 in 0.273s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d3e248c9-cb66-434f-8f1f-361651a3f8f8 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "cinder-quobyte-167a5d07-ba57-4afe-a015-ff20e0e50328" released by "delete_volume" :: held 0.714s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-64bec1ea-c2f7-4ae8-88a6-0fc6595d28bc tempest-SnapshotMetadataTestJSON-1444078529 None] Acquiring lock "cinder-697ee821-469d-4530-9837-da3698676842-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-64bec1ea-c2f7-4ae8-88a6-0fc6595d28bc tempest-SnapshotMetadataTestJSON-1444078529 None] Lock "cinder-697ee821-469d-4530-9837-da3698676842-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:44 devstack cinder-volume[85899]: WARNING cinder.quota [None req-d3e248c9-cb66-434f-8f1f-361651a3f8f8 tempest-TestInstancesWithCinderVolumes-991321737 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1528447311-532028425 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1528447311-532028425, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:50:44 devstack cinder-volume[85899]: WARNING cinder.quota [None req-d3e248c9-cb66-434f-8f1f-361651a3f8f8 tempest-TestInstancesWithCinderVolumes-991321737 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1528447311-532028425 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1528447311-532028425, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:50:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-64bec1ea-c2f7-4ae8-88a6-0fc6595d28bc tempest-SnapshotMetadataTestJSON-1444078529 None] Acquiring lock "cinder-quobyte-697ee821-469d-4530-9837-da3698676842" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:44 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-d3e248c9-cb66-434f-8f1f-361651a3f8f8 tempest-TestInstancesWithCinderVolumes-991321737 None] Created reservations ['cd391123-1248-42ff-b593-1d56fe87d45f', '98579b26-42bd-4f28-be65-2417fb6fca3f', 'deeba869-520e-4bab-bcc5-5dad03b160bb', '9c32cb5f-a507-4de6-8f1b-946277668fbd'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:50:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-64bec1ea-c2f7-4ae8-88a6-0fc6595d28bc tempest-SnapshotMetadataTestJSON-1444078529 None] Lock "cinder-quobyte-697ee821-469d-4530-9837-da3698676842" acquired by "delete_volume" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:44 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[922421f9-c4fe-45b8-b99a-65eaf2950acf]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:50:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-64bec1ea-c2f7-4ae8-88a6-0fc6595d28bc tempest-SnapshotMetadataTestJSON-1444078529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d3e248c9-cb66-434f-8f1f-361651a3f8f8 tempest-TestInstancesWithCinderVolumes-991321737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d3e248c9-cb66-434f-8f1f-361651a3f8f8 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d3e248c9-cb66-434f-8f1f-361651a3f8f8 tempest-TestInstancesWithCinderVolumes-991321737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d3e248c9-cb66-434f-8f1f-361651a3f8f8 tempest-TestInstancesWithCinderVolumes-991321737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d3e248c9-cb66-434f-8f1f-361651a3f8f8 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d3e248c9-cb66-434f-8f1f-361651a3f8f8 tempest-TestInstancesWithCinderVolumes-991321737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:44 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:50:44 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:44 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842 Sep 16 17:50:44 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:44 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d3e248c9-cb66-434f-8f1f-361651a3f8f8 tempest-TestInstancesWithCinderVolumes-991321737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.270s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:44 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-d3e248c9-cb66-434f-8f1f-361651a3f8f8 tempest-TestInstancesWithCinderVolumes-991321737 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:50:44 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-d3e248c9-cb66-434f-8f1f-361651a3f8f8 tempest-TestInstancesWithCinderVolumes-991321737 None] Deleted volume successfully. Sep 16 17:50:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d3e248c9-cb66-434f-8f1f-361651a3f8f8 tempest-TestInstancesWithCinderVolumes-991321737 None] Lock "cinder-167a5d07-ba57-4afe-a015-ff20e0e50328-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:44 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-64bec1ea-c2f7-4ae8-88a6-0fc6595d28bc tempest-SnapshotMetadataTestJSON-1444078529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842" returned: 0 in 0.406s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-64bec1ea-c2f7-4ae8-88a6-0fc6595d28bc tempest-SnapshotMetadataTestJSON-1444078529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:44 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842 Sep 16 17:50:44 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:45 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-64bec1ea-c2f7-4ae8-88a6-0fc6595d28bc tempest-SnapshotMetadataTestJSON-1444078529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-697ee821-469d-4530-9837-da3698676842" returned: 0 in 0.270s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-64bec1ea-c2f7-4ae8-88a6-0fc6595d28bc tempest-SnapshotMetadataTestJSON-1444078529 None] Lock "cinder-quobyte-697ee821-469d-4530-9837-da3698676842" released by "delete_volume" :: held 0.751s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:45 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-64bec1ea-c2f7-4ae8-88a6-0fc6595d28bc tempest-SnapshotMetadataTestJSON-1444078529 None] Created reservations ['017c16d8-ab11-411c-9d63-9c24b485f7e2', 'dbcacb74-796c-4680-aec8-d0171af0270f', '0639dff7-3b9a-4b2f-89b9-07cdc16f9291', 'cc047103-688b-4d6d-9416-a1a5cfe2d492'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:50:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-64bec1ea-c2f7-4ae8-88a6-0fc6595d28bc tempest-SnapshotMetadataTestJSON-1444078529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-64bec1ea-c2f7-4ae8-88a6-0fc6595d28bc tempest-SnapshotMetadataTestJSON-1444078529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-64bec1ea-c2f7-4ae8-88a6-0fc6595d28bc tempest-SnapshotMetadataTestJSON-1444078529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-64bec1ea-c2f7-4ae8-88a6-0fc6595d28bc tempest-SnapshotMetadataTestJSON-1444078529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-64bec1ea-c2f7-4ae8-88a6-0fc6595d28bc tempest-SnapshotMetadataTestJSON-1444078529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-64bec1ea-c2f7-4ae8-88a6-0fc6595d28bc tempest-SnapshotMetadataTestJSON-1444078529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:45 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:50:45 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:45 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-64bec1ea-c2f7-4ae8-88a6-0fc6595d28bc tempest-SnapshotMetadataTestJSON-1444078529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.286s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:45 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-64bec1ea-c2f7-4ae8-88a6-0fc6595d28bc tempest-SnapshotMetadataTestJSON-1444078529 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:50:45 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-64bec1ea-c2f7-4ae8-88a6-0fc6595d28bc tempest-SnapshotMetadataTestJSON-1444078529 None] Deleted volume successfully. Sep 16 17:50:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-64bec1ea-c2f7-4ae8-88a6-0fc6595d28bc tempest-SnapshotMetadataTestJSON-1444078529 None] Lock "cinder-697ee821-469d-4530-9837-da3698676842-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Flow 'volume_create_manager' (07686178-7e65-4eea-8f64-c045fe341cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd1a258-cae3-4e08-84eb-eb86c0045d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd1a258-cae3-4e08-84eb-eb86c0045d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2088269139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b8d66b-fe79-4d08-b593-4a90a53c67c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e158f26155a1464083f6ea3ae11b7b2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:50:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:50:49Z,use_quota=True,user_id='794a6d2eae05464db59697b3f6aefdda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86228001-41da-4ccd-a0e7-39601b3d9efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86228001-41da-4ccd-a0e7-39601b3d9efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a7b48b8-6694-481e-b10a-835f76149750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a7b48b8-6694-481e-b10a-835f76149750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41b8d66b-fe79-4d08-b593-4a90a53c67c3', 'volume_name': 'volume-41b8d66b-fe79-4d08-b593-4a90a53c67c3', 'volume_size': 2}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f940261-7018-4419-82ba-d0370e0f7243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f940261-7018-4419-82ba-d0370e0f7243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12793ae6-1805-4f83-a6e4-4881462e4901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:49 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Volume 41b8d66b-fe79-4d08-b593-4a90a53c67c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41b8d66b-fe79-4d08-b593-4a90a53c67c3', 'volume_size': 2} Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2088269139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b8d66b-fe79-4d08-b593-4a90a53c67c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e158f26155a1464083f6ea3ae11b7b2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:50:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:50:49Z,use_quota=True,user_id='794a6d2eae05464db59697b3f6aefdda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Creating volume 41b8d66b-fe79-4d08-b593-4a90a53c67c3 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:50:49 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41b8d66b-fe79-4d08-b593-4a90a53c67c3 2147483648 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:49 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41b8d66b-fe79-4d08-b593-4a90a53c67c3 2147483648 Sep 16 17:50:49 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:49 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41b8d66b-fe79-4d08-b593-4a90a53c67c3 2147483648" returned: 0 in 0.624s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41b8d66b-fe79-4d08-b593-4a90a53c67c3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:50 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41b8d66b-fe79-4d08-b593-4a90a53c67c3 Sep 16 17:50:50 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:50 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41b8d66b-fe79-4d08-b593-4a90a53c67c3" returned: 0 in 0.264s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:50 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:50:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12793ae6-1805-4f83-a6e4-4881462e4901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41b8d66b-fe79-4d08-b593-4a90a53c67c3', 'volume_size': 2}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292ce215-1756-453d-9503-5d9ff0805a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:50 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Volume volume-41b8d66b-fe79-4d08-b593-4a90a53c67c3 (41b8d66b-fe79-4d08-b593-4a90a53c67c3): created successfully Sep 16 17:50:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292ce215-1756-453d-9503-5d9ff0805a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Flow 'volume_create_manager' (07686178-7e65-4eea-8f64-c045fe341cb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:50:50 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-ad5cd037-6d4c-4267-a741-77c04a87f4d2 tempest-VolumesCloneNegativeTest-677140928 None] Created volume successfully. Sep 16 17:50:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-07667717-afe9-4174-82db-de1cc8931dbf tempest-VolumesCloneNegativeTest-677140928 None] Acquiring lock "cinder-41b8d66b-fe79-4d08-b593-4a90a53c67c3-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-07667717-afe9-4174-82db-de1cc8931dbf tempest-VolumesCloneNegativeTest-677140928 None] Lock "cinder-41b8d66b-fe79-4d08-b593-4a90a53c67c3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-07667717-afe9-4174-82db-de1cc8931dbf tempest-VolumesCloneNegativeTest-677140928 None] Acquiring lock "cinder-quobyte-41b8d66b-fe79-4d08-b593-4a90a53c67c3" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:50:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-07667717-afe9-4174-82db-de1cc8931dbf tempest-VolumesCloneNegativeTest-677140928 None] Lock "cinder-quobyte-41b8d66b-fe79-4d08-b593-4a90a53c67c3" acquired by "delete_volume" :: waited 0.023s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:50:51 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d26154-480f-4e64-8af6-7ead75d12fc8]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:50:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-07667717-afe9-4174-82db-de1cc8931dbf tempest-VolumesCloneNegativeTest-677140928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41b8d66b-fe79-4d08-b593-4a90a53c67c3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:51 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41b8d66b-fe79-4d08-b593-4a90a53c67c3 Sep 16 17:50:51 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:51 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-07667717-afe9-4174-82db-de1cc8931dbf tempest-VolumesCloneNegativeTest-677140928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41b8d66b-fe79-4d08-b593-4a90a53c67c3" returned: 0 in 0.378s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-07667717-afe9-4174-82db-de1cc8931dbf tempest-VolumesCloneNegativeTest-677140928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41b8d66b-fe79-4d08-b593-4a90a53c67c3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:51 devstack sudo[100408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41b8d66b-fe79-4d08-b593-4a90a53c67c3 Sep 16 17:50:51 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:52 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-07667717-afe9-4174-82db-de1cc8931dbf tempest-VolumesCloneNegativeTest-677140928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41b8d66b-fe79-4d08-b593-4a90a53c67c3" returned: 0 in 0.272s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:52 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-07667717-afe9-4174-82db-de1cc8931dbf tempest-VolumesCloneNegativeTest-677140928 None] Lock "cinder-quobyte-41b8d66b-fe79-4d08-b593-4a90a53c67c3" released by "delete_volume" :: held 0.703s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:52 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-07667717-afe9-4174-82db-de1cc8931dbf tempest-VolumesCloneNegativeTest-677140928 None] Created reservations ['86cbc549-8cd7-442f-a2e8-010778e230de', '5ced72ed-a5b6-4798-8fd7-3a46f897089f', '173d0aea-4b6c-4b06-aa4f-77c3ead75414', 'dfe8e55a-87df-414d-9a5a-b2052634b779'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:50:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-07667717-afe9-4174-82db-de1cc8931dbf tempest-VolumesCloneNegativeTest-677140928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-07667717-afe9-4174-82db-de1cc8931dbf tempest-VolumesCloneNegativeTest-677140928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-07667717-afe9-4174-82db-de1cc8931dbf tempest-VolumesCloneNegativeTest-677140928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-07667717-afe9-4174-82db-de1cc8931dbf tempest-VolumesCloneNegativeTest-677140928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-07667717-afe9-4174-82db-de1cc8931dbf tempest-VolumesCloneNegativeTest-677140928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-07667717-afe9-4174-82db-de1cc8931dbf tempest-VolumesCloneNegativeTest-677140928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:52 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:50:52 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:52 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-07667717-afe9-4174-82db-de1cc8931dbf tempest-VolumesCloneNegativeTest-677140928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.267s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:52 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-07667717-afe9-4174-82db-de1cc8931dbf tempest-VolumesCloneNegativeTest-677140928 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:50:52 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-07667717-afe9-4174-82db-de1cc8931dbf tempest-VolumesCloneNegativeTest-677140928 None] Deleted volume successfully. Sep 16 17:50:52 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-07667717-afe9-4174-82db-de1cc8931dbf tempest-VolumesCloneNegativeTest-677140928 None] Lock "cinder-41b8d66b-fe79-4d08-b593-4a90a53c67c3-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:50:56 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:50:56 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Flow 'volume_create_manager' (f079d100-8e13-420b-9248-4955f201bdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:50:56 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3604df89-7f56-4ac2-b038-b55cf82a4a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3604df89-7f56-4ac2-b038-b55cf82a4a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-326393754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c51eff5-c190-4463-94b9-7a8aa306bcfc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='676e5beb18534c0dada628efd21f4cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:50:57Z,use_quota=True,user_id='7a58c88ae3814bcab0d8c11faddb0e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6152c55f-9a04-441e-b2b3-247b15c1a2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6152c55f-9a04-441e-b2b3-247b15c1a2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d19ed0f-a98d-4725-a394-d9e1754d3a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d19ed0f-a98d-4725-a394-d9e1754d3a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c51eff5-c190-4463-94b9-7a8aa306bcfc', 'volume_name': 'volume-4c51eff5-c190-4463-94b9-7a8aa306bcfc', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9742d39d-6a42-4118-b8ca-24ed7925a2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9742d39d-6a42-4118-b8ca-24ed7925a2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66e66fb-73c5-4968-95f5-df9f0c3e5d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:57 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Volume 4c51eff5-c190-4463-94b9-7a8aa306bcfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c51eff5-c190-4463-94b9-7a8aa306bcfc', 'volume_size': 1} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-326393754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c51eff5-c190-4463-94b9-7a8aa306bcfc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='676e5beb18534c0dada628efd21f4cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:50:57Z,use_quota=True,user_id='7a58c88ae3814bcab0d8c11faddb0e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Creating volume 4c51eff5-c190-4463-94b9-7a8aa306bcfc {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:50:57 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c51eff5-c190-4463-94b9-7a8aa306bcfc 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:57 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c51eff5-c190-4463-94b9-7a8aa306bcfc 1073741824 Sep 16 17:50:57 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:57 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c51eff5-c190-4463-94b9-7a8aa306bcfc 1073741824" returned: 0 in 0.480s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c51eff5-c190-4463-94b9-7a8aa306bcfc {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:50:57 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c51eff5-c190-4463-94b9-7a8aa306bcfc Sep 16 17:50:57 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:50:57 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c51eff5-c190-4463-94b9-7a8aa306bcfc" returned: 0 in 0.262s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66e66fb-73c5-4968-95f5-df9f0c3e5d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c51eff5-c190-4463-94b9-7a8aa306bcfc', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17827550-9413-41e3-97c8-c998c373002e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:50:57 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Volume volume-4c51eff5-c190-4463-94b9-7a8aa306bcfc (4c51eff5-c190-4463-94b9-7a8aa306bcfc): created successfully Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17827550-9413-41e3-97c8-c998c373002e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:50:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Flow 'volume_create_manager' (f079d100-8e13-420b-9248-4955f201bdf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:50:57 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-fa74648b-f771-41e0-aac0-6ec3d5fff416 tempest-VolumesGetTest-575173115 None] Created volume successfully. Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Flow 'volume_create_manager' (47d7a917-b700-4f5f-a796-d104bdce03aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08544bc-a375-4f1a-8979-78eb3cbb23f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08544bc-a375-4f1a-8979-78eb3cbb23f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:51:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-341100091',display_name='tempest-VolumesGetTest-Volume-1569502526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf90ccf8-e8ad-45a9-9d49-dbda20054518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676e5beb18534c0dada628efd21f4cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:51:00Z,use_quota=True,user_id='7a58c88ae3814bcab0d8c11faddb0e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f7db89-a601-456f-9c1d-cdbb6f1d0d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f7db89-a601-456f-9c1d-cdbb6f1d0d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac81573a-3988-48af-940d-4e8df88a09e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac81573a-3988-48af-940d-4e8df88a09e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf90ccf8-e8ad-45a9-9d49-dbda20054518', 'volume_name': 'volume-bf90ccf8-e8ad-45a9-9d49-dbda20054518', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (196f7f37-ab98-488d-843d-68abcc74ae7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (196f7f37-ab98-488d-843d-68abcc74ae7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f8d5fa-4cef-4a1b-9841-faec83e64f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:00 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Volume bf90ccf8-e8ad-45a9-9d49-dbda20054518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf90ccf8-e8ad-45a9-9d49-dbda20054518', 'volume_size': 1} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:51:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-341100091',display_name='tempest-VolumesGetTest-Volume-1569502526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf90ccf8-e8ad-45a9-9d49-dbda20054518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676e5beb18534c0dada628efd21f4cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:51:00Z,use_quota=True,user_id='7a58c88ae3814bcab0d8c11faddb0e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Creating volume bf90ccf8-e8ad-45a9-9d49-dbda20054518 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:51:00 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bf90ccf8-e8ad-45a9-9d49-dbda20054518 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:00 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bf90ccf8-e8ad-45a9-9d49-dbda20054518 1073741824 Sep 16 17:51:00 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:00 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bf90ccf8-e8ad-45a9-9d49-dbda20054518 1073741824" returned: 0 in 0.469s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bf90ccf8-e8ad-45a9-9d49-dbda20054518 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:00 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bf90ccf8-e8ad-45a9-9d49-dbda20054518 Sep 16 17:51:00 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:00 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bf90ccf8-e8ad-45a9-9d49-dbda20054518" returned: 0 in 0.252s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f8d5fa-4cef-4a1b-9841-faec83e64f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf90ccf8-e8ad-45a9-9d49-dbda20054518', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34969970-3299-4b5e-a81e-de1f8ac1614c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:00 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Volume volume-bf90ccf8-e8ad-45a9-9d49-dbda20054518 (bf90ccf8-e8ad-45a9-9d49-dbda20054518): created successfully Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34969970-3299-4b5e-a81e-de1f8ac1614c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Flow 'volume_create_manager' (47d7a917-b700-4f5f-a796-d104bdce03aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:51:00 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-fcf2a578-70f6-4111-9d4c-ee3275d029b9 tempest-VolumesGetTest-575173115 None] Created volume successfully. Sep 16 17:51:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-884b2a97-3f21-4717-a90b-5f7254e21ee8 tempest-VolumesGetTest-575173115 None] Acquiring lock "cinder-bf90ccf8-e8ad-45a9-9d49-dbda20054518-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-884b2a97-3f21-4717-a90b-5f7254e21ee8 tempest-VolumesGetTest-575173115 None] Lock "cinder-bf90ccf8-e8ad-45a9-9d49-dbda20054518-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-884b2a97-3f21-4717-a90b-5f7254e21ee8 tempest-VolumesGetTest-575173115 None] Acquiring lock "cinder-quobyte-bf90ccf8-e8ad-45a9-9d49-dbda20054518" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-884b2a97-3f21-4717-a90b-5f7254e21ee8 tempest-VolumesGetTest-575173115 None] Lock "cinder-quobyte-bf90ccf8-e8ad-45a9-9d49-dbda20054518" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:01 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1887ff0-5e8b-44bc-a100-e2a9b532e844]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:51:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-884b2a97-3f21-4717-a90b-5f7254e21ee8 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bf90ccf8-e8ad-45a9-9d49-dbda20054518 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:01 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bf90ccf8-e8ad-45a9-9d49-dbda20054518 Sep 16 17:51:01 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:01 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-884b2a97-3f21-4717-a90b-5f7254e21ee8 tempest-VolumesGetTest-575173115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bf90ccf8-e8ad-45a9-9d49-dbda20054518" returned: 0 in 0.485s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-884b2a97-3f21-4717-a90b-5f7254e21ee8 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bf90ccf8-e8ad-45a9-9d49-dbda20054518 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:01 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bf90ccf8-e8ad-45a9-9d49-dbda20054518 Sep 16 17:51:01 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:02 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-884b2a97-3f21-4717-a90b-5f7254e21ee8 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bf90ccf8-e8ad-45a9-9d49-dbda20054518" returned: 0 in 0.271s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-884b2a97-3f21-4717-a90b-5f7254e21ee8 tempest-VolumesGetTest-575173115 None] Lock "cinder-quobyte-bf90ccf8-e8ad-45a9-9d49-dbda20054518" released by "delete_volume" :: held 0.806s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-884b2a97-3f21-4717-a90b-5f7254e21ee8 tempest-VolumesGetTest-575173115 None] Created reservations ['73c0b57c-f42f-49b7-a51f-aef7aeb00f98', 'de99028d-07fc-486a-bd55-36d676bd45a1', '0c3aca26-a159-44bf-a8a9-7c533fd8effe', '9e335d39-9f8b-4633-8de0-42dfe73f08f8'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-884b2a97-3f21-4717-a90b-5f7254e21ee8 tempest-VolumesGetTest-575173115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-884b2a97-3f21-4717-a90b-5f7254e21ee8 tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-884b2a97-3f21-4717-a90b-5f7254e21ee8 tempest-VolumesGetTest-575173115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-884b2a97-3f21-4717-a90b-5f7254e21ee8 tempest-VolumesGetTest-575173115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-884b2a97-3f21-4717-a90b-5f7254e21ee8 tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-884b2a97-3f21-4717-a90b-5f7254e21ee8 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:51:02 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:51:02 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:02 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:51:02 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-af621e1b-a56a-42bf-882c-b86b542eceeb tempest-VolumesGetTest-575173115 None] Acquiring lock "cinder-4c51eff5-c190-4463-94b9-7a8aa306bcfc-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:02 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-884b2a97-3f21-4717-a90b-5f7254e21ee8 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.329s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-884b2a97-3f21-4717-a90b-5f7254e21ee8 tempest-VolumesGetTest-575173115 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:51:02 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-884b2a97-3f21-4717-a90b-5f7254e21ee8 tempest-VolumesGetTest-575173115 None] Deleted volume successfully. Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-af621e1b-a56a-42bf-882c-b86b542eceeb tempest-VolumesGetTest-575173115 None] Lock "cinder-4c51eff5-c190-4463-94b9-7a8aa306bcfc-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-884b2a97-3f21-4717-a90b-5f7254e21ee8 tempest-VolumesGetTest-575173115 None] Lock "cinder-bf90ccf8-e8ad-45a9-9d49-dbda20054518-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=129,cinder:INSERT=37,cinder:UPDATE=162,cinder:DELETE=15 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:INSERT=40,cinder:UPDATE=170,cinder:SELECT=116,cinder:DELETE=13 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:51:02 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.376s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager._thread_info {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread count: 28 {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread info: [<_MainThread(MainThread, started 123748124422272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-af621e1b-a56a-42bf-882c-b86b542eceeb tempest-VolumesGetTest-575173115 None] Acquiring lock "cinder-quobyte-4c51eff5-c190-4463-94b9-7a8aa306bcfc" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-af621e1b-a56a-42bf-882c-b86b542eceeb tempest-VolumesGetTest-575173115 None] Lock "cinder-quobyte-4c51eff5-c190-4463-94b9-7a8aa306bcfc" acquired by "delete_volume" :: waited 0.025s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[44362177-063c-4fd9-8c9f-3a5424b9f8a9]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:51:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-af621e1b-a56a-42bf-882c-b86b542eceeb tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c51eff5-c190-4463-94b9-7a8aa306bcfc {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:02 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c51eff5-c190-4463-94b9-7a8aa306bcfc Sep 16 17:51:02 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:03 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-af621e1b-a56a-42bf-882c-b86b542eceeb tempest-VolumesGetTest-575173115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c51eff5-c190-4463-94b9-7a8aa306bcfc" returned: 0 in 0.412s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-af621e1b-a56a-42bf-882c-b86b542eceeb tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c51eff5-c190-4463-94b9-7a8aa306bcfc {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:03 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c51eff5-c190-4463-94b9-7a8aa306bcfc Sep 16 17:51:03 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:03 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-af621e1b-a56a-42bf-882c-b86b542eceeb tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c51eff5-c190-4463-94b9-7a8aa306bcfc" returned: 0 in 0.307s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:03 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-af621e1b-a56a-42bf-882c-b86b542eceeb tempest-VolumesGetTest-575173115 None] Lock "cinder-quobyte-4c51eff5-c190-4463-94b9-7a8aa306bcfc" released by "delete_volume" :: held 0.774s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:51:03 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-af621e1b-a56a-42bf-882c-b86b542eceeb tempest-VolumesGetTest-575173115 None] Created reservations ['ae1c116e-0851-4379-bc57-6eff8253fb10', 'bdf385c4-5c85-4dc7-bad9-4ba723aaacfd', '66b83480-fb11-42b9-80bf-80f5a7043f72', 'c24a1c7c-e6a2-4f61-8116-6ad1bb33acb3'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:51:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-af621e1b-a56a-42bf-882c-b86b542eceeb tempest-VolumesGetTest-575173115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-af621e1b-a56a-42bf-882c-b86b542eceeb tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-af621e1b-a56a-42bf-882c-b86b542eceeb tempest-VolumesGetTest-575173115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:51:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-af621e1b-a56a-42bf-882c-b86b542eceeb tempest-VolumesGetTest-575173115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:51:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-af621e1b-a56a-42bf-882c-b86b542eceeb tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-af621e1b-a56a-42bf-882c-b86b542eceeb tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:03 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:51:03 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:03 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-af621e1b-a56a-42bf-882c-b86b542eceeb tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.348s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:03 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-af621e1b-a56a-42bf-882c-b86b542eceeb tempest-VolumesGetTest-575173115 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:51:03 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-af621e1b-a56a-42bf-882c-b86b542eceeb tempest-VolumesGetTest-575173115 None] Deleted volume successfully. Sep 16 17:51:03 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-af621e1b-a56a-42bf-882c-b86b542eceeb tempest-VolumesGetTest-575173115 None] Lock "cinder-4c51eff5-c190-4463-94b9-7a8aa306bcfc-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Flow 'volume_create_manager' (05b22fbb-3dfd-4614-8570-f1e112e26b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2264ade-c4ea-4bcb-b57f-6a5875d51184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2264ade-c4ea-4bcb-b57f-6a5875d51184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1956292522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b6d310-3809-4866-8763-a645e691dcb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676e5beb18534c0dada628efd21f4cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:51:04Z,use_quota=True,user_id='7a58c88ae3814bcab0d8c11faddb0e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3fea2cb-4482-402b-b32e-879d0862daf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3fea2cb-4482-402b-b32e-879d0862daf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47303f3-a925-4897-b547-2805891f530a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47303f3-a925-4897-b547-2805891f530a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4b6d310-3809-4866-8763-a645e691dcb3', 'volume_name': 'volume-d4b6d310-3809-4866-8763-a645e691dcb3', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6abb47bd-b521-4383-b9e8-4af5577d3d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6abb47bd-b521-4383-b9e8-4af5577d3d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb230207-43a2-4cda-a7b9-20b5b7900ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:04 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Volume d4b6d310-3809-4866-8763-a645e691dcb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4b6d310-3809-4866-8763-a645e691dcb3', 'volume_size': 1} Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1956292522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b6d310-3809-4866-8763-a645e691dcb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676e5beb18534c0dada628efd21f4cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:51:04Z,use_quota=True,user_id='7a58c88ae3814bcab0d8c11faddb0e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Creating volume d4b6d310-3809-4866-8763-a645e691dcb3 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:51:04 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:04 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3 1073741824 Sep 16 17:51:04 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:04 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3 1073741824" returned: 0 in 0.461s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:04 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3 Sep 16 17:51:04 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:05 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3" returned: 0 in 0.325s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:05 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:51:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:05 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb230207-43a2-4cda-a7b9-20b5b7900ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4b6d310-3809-4866-8763-a645e691dcb3', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:05 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22c5b197-b156-44aa-9645-c6bcf4a2a757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:05 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Volume volume-d4b6d310-3809-4866-8763-a645e691dcb3 (d4b6d310-3809-4866-8763-a645e691dcb3): created successfully Sep 16 17:51:05 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22c5b197-b156-44aa-9645-c6bcf4a2a757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:05 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Flow 'volume_create_manager' (05b22fbb-3dfd-4614-8570-f1e112e26b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:51:05 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-d96c93d8-0da1-4187-9a21-91ff1ce4e718 tempest-VolumesGetTest-575173115 None] Created volume successfully. Sep 16 17:51:06 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:51:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Flow 'volume_create_manager' (91beec99-5159-4708-ab8f-3951bac96c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:51:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f567283b-f7a2-4bce-8996-ed13fdecc7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f567283b-f7a2-4bce-8996-ed13fdecc7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1454688952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37880602-c91c-45dd-9baf-98be92187648,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='676e5beb18534c0dada628efd21f4cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d4b6d310-3809-4866-8763-a645e691dcb3,status='creating',terminated_at=None,updated_at=2026-09-16T15:51:07Z,use_quota=True,user_id='7a58c88ae3814bcab0d8c11faddb0e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3af847-728c-4093-8c1c-a4fba5a53bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3af847-728c-4093-8c1c-a4fba5a53bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a7beab-9392-43ae-8d45-caeed3c1a45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a7beab-9392-43ae-8d45-caeed3c1a45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '37880602-c91c-45dd-9baf-98be92187648', 'volume_name': 'volume-37880602-c91c-45dd-9baf-98be92187648', 'volume_size': 1, 'source_volid': 'd4b6d310-3809-4866-8763-a645e691dcb3', 'source_volstatus': 'available'}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e07e3222-fe9b-42db-b65e-459cdb6d73bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e07e3222-fe9b-42db-b65e-459cdb6d73bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:06 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9da4bb9-c1b3-4e01-8ac0-91166af8c86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:06 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Volume 37880602-c91c-45dd-9baf-98be92187648: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-37880602-c91c-45dd-9baf-98be92187648', 'volume_size': 1, 'source_volid': 'd4b6d310-3809-4866-8763-a645e691dcb3', 'source_volstatus': 'available'} Sep 16 17:51:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:07 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Cloning volume d4b6d310-3809-4866-8763-a645e691dcb3 to volume 37880602-c91c-45dd-9baf-98be92187648 Sep 16 17:51:07 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Creating offline snapshot facf1869-be19-45bb-b9d1-62f755a1200c of volume d4b6d310-3809-4866-8763-a645e691dcb3 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:51:07 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6102c2-70ec-4443-b81a-ec013b9c8261]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:51:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:07 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3 Sep 16 17:51:07 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:07 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3" returned: 0 in 0.427s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.facf1869-be19-45bb-b9d1-62f755a1200c 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:07 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.facf1869-be19-45bb-b9d1-62f755a1200c 1G Sep 16 17:51:07 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:07 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.facf1869-be19-45bb-b9d1-62f755a1200c 1G" returned: 0 in 0.436s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b6d310-3809-4866-8763-a645e691dcb3 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.facf1869-be19-45bb-b9d1-62f755a1200c {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:07 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b6d310-3809-4866-8763-a645e691dcb3 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.facf1869-be19-45bb-b9d1-62f755a1200c Sep 16 17:51:07 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:08 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b6d310-3809-4866-8763-a645e691dcb3 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.facf1869-be19-45bb-b9d1-62f755a1200c" returned: 0 in 0.314s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:08 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.facf1869-be19-45bb-b9d1-62f755a1200c is being set with open permissions: ugo+rw Sep 16 17:51:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.facf1869-be19-45bb-b9d1-62f755a1200c {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:08 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.facf1869-be19-45bb-b9d1-62f755a1200c Sep 16 17:51:08 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:08 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.facf1869-be19-45bb-b9d1-62f755a1200c" returned: 0 in 0.276s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:08 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.info Sep 16 17:51:08 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:08 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.info" returned: 0 in 0.256s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:08 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.info is being set with open permissions: ugo+rw Sep 16 17:51:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:08 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.info Sep 16 17:51:08 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:09 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.info" returned: 0 in 0.255s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:09 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Acquiring lock "cinder-quobyte-37880602-c91c-45dd-9baf-98be92187648" by "_copy_volume_from_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:09 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Lock "cinder-quobyte-37880602-c91c-45dd-9baf-98be92187648" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] snapshot: facf1869-be19-45bb-b9d1-62f755a1200c, volume: 37880602-c91c-45dd-9baf-98be92187648, {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 17:51:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:51:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:51:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:09 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b922c234-21f2-4281-862f-ddf2a9cb06c1]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:51:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.facf1869-be19-45bb-b9d1-62f755a1200c {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:09 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.facf1869-be19-45bb-b9d1-62f755a1200c Sep 16 17:51:09 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:09 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.facf1869-be19-45bb-b9d1-62f755a1200c" returned: 0 in 0.413s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4b6d310-3809-4866-8763-a645e691dcb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:51:09 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a346c25-9f97-460a-a547-c8100c83ed71]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:51:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:09 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3 Sep 16 17:51:09 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:09 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3" returned: 0 in 0.416s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3 {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 17:51:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Creating direct copy from snapshot {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 17:51:09 devstack cinder-volume[85899]: DEBUG cinder.utils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Path /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-37880602-c91c-45dd-9baf-98be92187648 not found in is_blk_device check {{(pid=85899) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 17:51:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-37880602-c91c-45dd-9baf-98be92187648 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:10 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-37880602-c91c-45dd-9baf-98be92187648 Sep 16 17:51:10 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:17 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-37880602-c91c-45dd-9baf-98be92187648" returned: 0 in 7.335s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:17 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Image conversion details: src /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3, size 1024.00 MB, duration 7.34 sec, destination /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-37880602-c91c-45dd-9baf-98be92187648 {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:51:17 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Converted 1024.00 MB image at 139.57 MB/s Sep 16 17:51:17 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-37880602-c91c-45dd-9baf-98be92187648 is being set with open permissions: ugo+rw Sep 16 17:51:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-37880602-c91c-45dd-9baf-98be92187648 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:17 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-37880602-c91c-45dd-9baf-98be92187648 Sep 16 17:51:17 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:17 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-37880602-c91c-45dd-9baf-98be92187648" returned: 0 in 0.256s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Lock "cinder-quobyte-37880602-c91c-45dd-9baf-98be92187648" released by "_copy_volume_from_snapshot" :: held 8.501s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:51:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Acquiring lock "cinder-quobyte-facf1869-be19-45bb-b9d1-62f755a1200c" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Lock "cinder-quobyte-facf1869-be19-45bb-b9d1-62f755a1200c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Deleting offline snapshot facf1869-be19-45bb-b9d1-62f755a1200c of volume d4b6d310-3809-4866-8763-a645e691dcb3 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:51:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] snapshot_file for this snap is: volume-d4b6d310-3809-4866-8763-a645e691dcb3.facf1869-be19-45bb-b9d1-62f755a1200c {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:51:17 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfe659a-a0da-4a46-9666-bad65cb21eb9]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:51:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.facf1869-be19-45bb-b9d1-62f755a1200c {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:17 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.facf1869-be19-45bb-b9d1-62f755a1200c Sep 16 17:51:17 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:18 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.facf1869-be19-45bb-b9d1-62f755a1200c" returned: 0 in 0.409s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4b6d310-3809-4866-8763-a645e691dcb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:51:18 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c5a056-50af-40e4-b2ba-e91222525e6a]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:51:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:18 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3 Sep 16 17:51:18 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:18 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3" returned: 0 in 0.630s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.facf1869-be19-45bb-b9d1-62f755a1200c {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:18 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.facf1869-be19-45bb-b9d1-62f755a1200c Sep 16 17:51:18 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:19 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.facf1869-be19-45bb-b9d1-62f755a1200c" returned: 0 in 0.381s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.facf1869-be19-45bb-b9d1-62f755a1200c {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:19 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.facf1869-be19-45bb-b9d1-62f755a1200c Sep 16 17:51:19 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:19 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3.facf1869-be19-45bb-b9d1-62f755a1200c" returned: 0 in 0.266s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:19 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Lock "cinder-quobyte-facf1869-be19-45bb-b9d1-62f755a1200c" released by "_delete_snapshot" :: held 1.805s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:51:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.476s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9da4bb9-c1b3-4e01-8ac0-91166af8c86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37880602-c91c-45dd-9baf-98be92187648', 'volume_size': 1, 'source_volid': 'd4b6d310-3809-4866-8763-a645e691dcb3', 'source_volstatus': 'available'}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f629eecd-5205-4fa0-bb2c-3de211fe4f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:19 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Volume volume-37880602-c91c-45dd-9baf-98be92187648 (37880602-c91c-45dd-9baf-98be92187648): created successfully Sep 16 17:51:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f629eecd-5205-4fa0-bb2c-3de211fe4f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Flow 'volume_create_manager' (91beec99-5159-4708-ab8f-3951bac96c08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:51:19 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-ecdba125-5fc4-4671-8a02-c3ae7bbff9f4 tempest-VolumesGetTest-575173115 None] Created volume successfully. Sep 16 17:51:20 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:51:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Flow 'volume_create_manager' (9f4f2652-e121-4cab-915d-8f26f7ddb830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:51:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0d36a3-599c-4578-89b0-27a647811aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0d36a3-599c-4578-89b0-27a647811aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:51:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1522740509',display_name='tempest-VolumesGetTest-Volume-1489414205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44e7c0d-88bc-4f69-8b75-38b9d5cc9951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676e5beb18534c0dada628efd21f4cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:51:21Z,use_quota=True,user_id='7a58c88ae3814bcab0d8c11faddb0e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ab6dc8-6eda-4e45-94fc-3109c19e2f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ab6dc8-6eda-4e45-94fc-3109c19e2f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d37adf0-19f1-4403-8e67-3df3d4bfb20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d37adf0-19f1-4403-8e67-3df3d4bfb20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a44e7c0d-88bc-4f69-8b75-38b9d5cc9951', 'volume_name': 'volume-a44e7c0d-88bc-4f69-8b75-38b9d5cc9951', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599d34eb-56e3-4c34-b0eb-7b95c4b4bb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599d34eb-56e3-4c34-b0eb-7b95c4b4bb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0768a1b0-88ee-4335-91ae-7f2c9f7f2ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:20 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Volume a44e7c0d-88bc-4f69-8b75-38b9d5cc9951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a44e7c0d-88bc-4f69-8b75-38b9d5cc9951', 'volume_size': 1} Sep 16 17:51:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:51:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1522740509',display_name='tempest-VolumesGetTest-Volume-1489414205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44e7c0d-88bc-4f69-8b75-38b9d5cc9951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676e5beb18534c0dada628efd21f4cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:51:21Z,use_quota=True,user_id='7a58c88ae3814bcab0d8c11faddb0e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:51:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Creating volume a44e7c0d-88bc-4f69-8b75-38b9d5cc9951 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:51:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:51:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:51:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:51:20 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:51:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a44e7c0d-88bc-4f69-8b75-38b9d5cc9951 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:20 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a44e7c0d-88bc-4f69-8b75-38b9d5cc9951 1073741824 Sep 16 17:51:20 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:21 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a44e7c0d-88bc-4f69-8b75-38b9d5cc9951 1073741824" returned: 0 in 0.483s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a44e7c0d-88bc-4f69-8b75-38b9d5cc9951 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:21 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a44e7c0d-88bc-4f69-8b75-38b9d5cc9951 Sep 16 17:51:21 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:21 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a44e7c0d-88bc-4f69-8b75-38b9d5cc9951" returned: 0 in 0.292s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:51:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0768a1b0-88ee-4335-91ae-7f2c9f7f2ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a44e7c0d-88bc-4f69-8b75-38b9d5cc9951', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a93995d-c602-4b45-82f2-36a68fbacbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:21 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Volume volume-a44e7c0d-88bc-4f69-8b75-38b9d5cc9951 (a44e7c0d-88bc-4f69-8b75-38b9d5cc9951): created successfully Sep 16 17:51:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a93995d-c602-4b45-82f2-36a68fbacbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Flow 'volume_create_manager' (9f4f2652-e121-4cab-915d-8f26f7ddb830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:51:21 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-f0b2fd45-e791-4aa8-bd95-b59134dbdbb5 tempest-VolumesGetTest-575173115 None] Created volume successfully. Sep 16 17:51:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b18f6dd9-f6e0-4881-a316-8e2516cdb6df tempest-VolumesGetTest-575173115 None] Acquiring lock "cinder-a44e7c0d-88bc-4f69-8b75-38b9d5cc9951-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b18f6dd9-f6e0-4881-a316-8e2516cdb6df tempest-VolumesGetTest-575173115 None] Lock "cinder-a44e7c0d-88bc-4f69-8b75-38b9d5cc9951-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b18f6dd9-f6e0-4881-a316-8e2516cdb6df tempest-VolumesGetTest-575173115 None] Acquiring lock "cinder-quobyte-a44e7c0d-88bc-4f69-8b75-38b9d5cc9951" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b18f6dd9-f6e0-4881-a316-8e2516cdb6df tempest-VolumesGetTest-575173115 None] Lock "cinder-quobyte-a44e7c0d-88bc-4f69-8b75-38b9d5cc9951" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:23 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5da4aec-86ce-44bd-be07-d63d9747843b]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:51:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b18f6dd9-f6e0-4881-a316-8e2516cdb6df tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a44e7c0d-88bc-4f69-8b75-38b9d5cc9951 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:23 devstack sudo[100560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a44e7c0d-88bc-4f69-8b75-38b9d5cc9951 Sep 16 17:51:23 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:23 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b18f6dd9-f6e0-4881-a316-8e2516cdb6df tempest-VolumesGetTest-575173115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a44e7c0d-88bc-4f69-8b75-38b9d5cc9951" returned: 0 in 0.481s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b18f6dd9-f6e0-4881-a316-8e2516cdb6df tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a44e7c0d-88bc-4f69-8b75-38b9d5cc9951 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:23 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a44e7c0d-88bc-4f69-8b75-38b9d5cc9951 Sep 16 17:51:23 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:23 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b18f6dd9-f6e0-4881-a316-8e2516cdb6df tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a44e7c0d-88bc-4f69-8b75-38b9d5cc9951" returned: 0 in 0.264s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b18f6dd9-f6e0-4881-a316-8e2516cdb6df tempest-VolumesGetTest-575173115 None] Lock "cinder-quobyte-a44e7c0d-88bc-4f69-8b75-38b9d5cc9951" released by "delete_volume" :: held 0.806s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:51:23 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-b18f6dd9-f6e0-4881-a316-8e2516cdb6df tempest-VolumesGetTest-575173115 None] Created reservations ['bc2b0ea3-a557-4db3-8bdd-3ddc3460c809', '3835f90d-dd9f-4ad9-80b4-83098302e627', '2a3e0989-fe3c-4786-84ce-cadd40067d41', '323f28b5-7985-4ef8-9f1f-6c106fe04dcb'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:51:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b18f6dd9-f6e0-4881-a316-8e2516cdb6df tempest-VolumesGetTest-575173115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b18f6dd9-f6e0-4881-a316-8e2516cdb6df tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b18f6dd9-f6e0-4881-a316-8e2516cdb6df tempest-VolumesGetTest-575173115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:51:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b18f6dd9-f6e0-4881-a316-8e2516cdb6df tempest-VolumesGetTest-575173115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:51:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b18f6dd9-f6e0-4881-a316-8e2516cdb6df tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b18f6dd9-f6e0-4881-a316-8e2516cdb6df tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:24 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:51:24 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-73e60258-743a-4593-ba13-eb70837e92f9 tempest-VolumesGetTest-575173115 None] Acquiring lock "cinder-37880602-c91c-45dd-9baf-98be92187648-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-73e60258-743a-4593-ba13-eb70837e92f9 tempest-VolumesGetTest-575173115 None] Lock "cinder-37880602-c91c-45dd-9baf-98be92187648-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:24 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b18f6dd9-f6e0-4881-a316-8e2516cdb6df tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.340s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:24 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b18f6dd9-f6e0-4881-a316-8e2516cdb6df tempest-VolumesGetTest-575173115 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:51:24 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-b18f6dd9-f6e0-4881-a316-8e2516cdb6df tempest-VolumesGetTest-575173115 None] Deleted volume successfully. Sep 16 17:51:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-73e60258-743a-4593-ba13-eb70837e92f9 tempest-VolumesGetTest-575173115 None] Acquiring lock "cinder-quobyte-37880602-c91c-45dd-9baf-98be92187648" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-73e60258-743a-4593-ba13-eb70837e92f9 tempest-VolumesGetTest-575173115 None] Lock "cinder-quobyte-37880602-c91c-45dd-9baf-98be92187648" acquired by "delete_volume" :: waited 0.022s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b18f6dd9-f6e0-4881-a316-8e2516cdb6df tempest-VolumesGetTest-575173115 None] Lock "cinder-a44e7c0d-88bc-4f69-8b75-38b9d5cc9951-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:51:24 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b7f296-c37c-4015-8436-bfd0c9a2a4bf]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:51:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-73e60258-743a-4593-ba13-eb70837e92f9 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-37880602-c91c-45dd-9baf-98be92187648 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:24 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-37880602-c91c-45dd-9baf-98be92187648 Sep 16 17:51:24 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:24 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-73e60258-743a-4593-ba13-eb70837e92f9 tempest-VolumesGetTest-575173115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-37880602-c91c-45dd-9baf-98be92187648" returned: 0 in 0.430s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-73e60258-743a-4593-ba13-eb70837e92f9 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-37880602-c91c-45dd-9baf-98be92187648 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:24 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-37880602-c91c-45dd-9baf-98be92187648 Sep 16 17:51:24 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:25 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-73e60258-743a-4593-ba13-eb70837e92f9 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-37880602-c91c-45dd-9baf-98be92187648" returned: 0 in 0.295s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-73e60258-743a-4593-ba13-eb70837e92f9 tempest-VolumesGetTest-575173115 None] Lock "cinder-quobyte-37880602-c91c-45dd-9baf-98be92187648" released by "delete_volume" :: held 0.774s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:51:25 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-73e60258-743a-4593-ba13-eb70837e92f9 tempest-VolumesGetTest-575173115 None] Created reservations ['89e3dbe8-12eb-4eaf-99d6-df3bf61f7095', '906f63c9-3e4a-45d1-b943-e647a2cdb897', 'cd3f3db3-f49a-493d-8cad-edd65cfab05a', 'a9ecca2b-c236-400c-a974-911bd58212cc'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:51:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-73e60258-743a-4593-ba13-eb70837e92f9 tempest-VolumesGetTest-575173115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-73e60258-743a-4593-ba13-eb70837e92f9 tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-73e60258-743a-4593-ba13-eb70837e92f9 tempest-VolumesGetTest-575173115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:51:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-73e60258-743a-4593-ba13-eb70837e92f9 tempest-VolumesGetTest-575173115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:51:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-73e60258-743a-4593-ba13-eb70837e92f9 tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-73e60258-743a-4593-ba13-eb70837e92f9 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:25 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:51:25 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8ffd2a75-3cc1-4939-9a64-022a8a823ef3 tempest-VolumesGetTest-575173115 None] Acquiring lock "cinder-d4b6d310-3809-4866-8763-a645e691dcb3-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:25 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-73e60258-743a-4593-ba13-eb70837e92f9 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.331s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:25 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-73e60258-743a-4593-ba13-eb70837e92f9 tempest-VolumesGetTest-575173115 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:51:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8ffd2a75-3cc1-4939-9a64-022a8a823ef3 tempest-VolumesGetTest-575173115 None] Lock "cinder-d4b6d310-3809-4866-8763-a645e691dcb3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:25 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-73e60258-743a-4593-ba13-eb70837e92f9 tempest-VolumesGetTest-575173115 None] Deleted volume successfully. Sep 16 17:51:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-73e60258-743a-4593-ba13-eb70837e92f9 tempest-VolumesGetTest-575173115 None] Lock "cinder-37880602-c91c-45dd-9baf-98be92187648-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:51:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8ffd2a75-3cc1-4939-9a64-022a8a823ef3 tempest-VolumesGetTest-575173115 None] Acquiring lock "cinder-quobyte-d4b6d310-3809-4866-8763-a645e691dcb3" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8ffd2a75-3cc1-4939-9a64-022a8a823ef3 tempest-VolumesGetTest-575173115 None] Lock "cinder-quobyte-d4b6d310-3809-4866-8763-a645e691dcb3" acquired by "delete_volume" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:25 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd43276-f4b8-4fd9-8ff1-4496a598bb6a]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:51:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8ffd2a75-3cc1-4939-9a64-022a8a823ef3 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:25 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3 Sep 16 17:51:25 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:26 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8ffd2a75-3cc1-4939-9a64-022a8a823ef3 tempest-VolumesGetTest-575173115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3" returned: 0 in 0.441s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8ffd2a75-3cc1-4939-9a64-022a8a823ef3 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:26 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3 Sep 16 17:51:26 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:26 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8ffd2a75-3cc1-4939-9a64-022a8a823ef3 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d4b6d310-3809-4866-8763-a645e691dcb3" returned: 0 in 0.360s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:26 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8ffd2a75-3cc1-4939-9a64-022a8a823ef3 tempest-VolumesGetTest-575173115 None] Lock "cinder-quobyte-d4b6d310-3809-4866-8763-a645e691dcb3" released by "delete_volume" :: held 0.872s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:51:26 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-8ffd2a75-3cc1-4939-9a64-022a8a823ef3 tempest-VolumesGetTest-575173115 None] Created reservations ['a5405f80-7851-4390-9b41-49a5ada5b5ee', '04ca2d57-fbe1-457f-a56a-3b3da8a42da0', '6e81b3c8-9d7d-43bf-a4ee-fa4e78fbebd4', '79ade663-237d-45f0-b48a-517c05599904'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:51:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8ffd2a75-3cc1-4939-9a64-022a8a823ef3 tempest-VolumesGetTest-575173115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8ffd2a75-3cc1-4939-9a64-022a8a823ef3 tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8ffd2a75-3cc1-4939-9a64-022a8a823ef3 tempest-VolumesGetTest-575173115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:51:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8ffd2a75-3cc1-4939-9a64-022a8a823ef3 tempest-VolumesGetTest-575173115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:51:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8ffd2a75-3cc1-4939-9a64-022a8a823ef3 tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8ffd2a75-3cc1-4939-9a64-022a8a823ef3 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:26 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:51:26 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:27 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8ffd2a75-3cc1-4939-9a64-022a8a823ef3 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.409s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:27 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-8ffd2a75-3cc1-4939-9a64-022a8a823ef3 tempest-VolumesGetTest-575173115 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:51:27 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-8ffd2a75-3cc1-4939-9a64-022a8a823ef3 tempest-VolumesGetTest-575173115 None] Deleted volume successfully. Sep 16 17:51:27 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8ffd2a75-3cc1-4939-9a64-022a8a823ef3 tempest-VolumesGetTest-575173115 None] Lock "cinder-d4b6d310-3809-4866-8763-a645e691dcb3-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:51:28 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:51:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Flow 'volume_create_manager' (dc80b807-bce4-43ad-98d8-af55c4ccdfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:51:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171a7f55-fa53-44d6-8714-e8e8b246d19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171a7f55-fa53-44d6-8714-e8e8b246d19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1752356100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d1e3a4-7fbc-4266-9dd9-900d3e865ed8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='676e5beb18534c0dada628efd21f4cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:51:28Z,use_quota=True,user_id='7a58c88ae3814bcab0d8c11faddb0e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea83eb7f-571d-4ce7-bd81-2a3b0205145c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea83eb7f-571d-4ce7-bd81-2a3b0205145c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac940b0-887c-4801-8627-84bcabdd06c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:28 devstack cinder-volume[85899]: DEBUG cinder.image.glance [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Creating Keystone auth plugin from conf {{(pid=85899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 17:51:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac940b0-887c-4801-8627-84bcabdd06c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '22d1e3a4-7fbc-4266-9dd9-900d3e865ed8', 'volume_name': 'volume-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8', 'volume_size': 1, 'image_id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '124a9fc6f0b448c1afab7b2b666efe75', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'created_at': datetime.datetime(2026, 9, 16, 15, 30, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 30, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81ac455d-f592-4ef7-8c27-23e4054a633b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a8d1951-35f7-4887-a594-fa317cb1d329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a8d1951-35f7-4887-a594-fa317cb1d329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa00eef-053e-4284-a8c7-245e70ac9ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:28 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Volume 22d1e3a4-7fbc-4266-9dd9-900d3e865ed8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8', 'volume_size': 1, 'image_id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '124a9fc6f0b448c1afab7b2b666efe75', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'created_at': datetime.datetime(2026, 9, 16, 15, 30, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 30, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81ac455d-f592-4ef7-8c27-23e4054a633b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 17:51:28 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Trying to clone 22d1e3a4-7fbc-4266-9dd9-900d3e865ed8 from image 81ac455d-f592-4ef7-8c27-23e4054a633b at location (None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}]). {{(pid=85899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 17:51:28 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_wb_f04kbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 16 17:51:28 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Image download 20.69 MB at 20.69 MB/s Sep 16 17:51:29 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0899f65f-e5d6-4087-87f3-55905ae227ea]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:51:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_wb_f04kbdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:29 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_wb_f04kbdevstack@QuobyteHD Sep 16 17:51:29 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:29 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_wb_f04kbdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:29 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Temporary image 81ac455d-f592-4ef7-8c27-23e4054a633b is fetched for user 7a58c88ae3814bcab0d8c11faddb0e6e. {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 16 17:51:29 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aefb57e-e125-428d-ab0d-1e420831fae0]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:51:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_wb_f04kbdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:29 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_wb_f04kbdevstack@QuobyteHD Sep 16 17:51:29 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:29 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_wb_f04kbdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1752356100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d1e3a4-7fbc-4266-9dd9-900d3e865ed8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='676e5beb18534c0dada628efd21f4cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:51:28Z,use_quota=True,user_id='7a58c88ae3814bcab0d8c11faddb0e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:51:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Creating volume 22d1e3a4-7fbc-4266-9dd9-900d3e865ed8 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:51:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:51:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:51:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:51:29 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:51:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:29 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8 1073741824 Sep 16 17:51:29 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:30 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8 1073741824" returned: 0 in 0.516s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:30 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8 Sep 16 17:51:30 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:30 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8" returned: 0 in 0.278s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:51:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:30 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Attempting download of 81ac455d-f592-4ef7-8c27-23e4054a633b ((None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}])) to volume 22d1e3a4-7fbc-4266-9dd9-900d3e865ed8. {{(pid=85899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 17:51:30 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f72cae-8280-425a-a985-075699d803e7]: (4, 'raw') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:51:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_wgyxbb31 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:30 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_wgyxbb31 Sep 16 17:51:30 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:31 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_wgyxbb31" returned: 0 in 0.368s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_wgyxbb31 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:31 devstack sudo[100705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_wgyxbb31 Sep 16 17:51:31 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:31 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_wgyxbb31" returned: 1 in 0.384s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81ac455d-f592-4ef7-8c27-23e4054a633b_wgyxbb31' failed. Not Retrying. {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:51:31 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d0ab00-ca95-493c-b6f9-c5f572298096]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:51:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_wb_f04kbdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:31 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_wb_f04kbdevstack@QuobyteHD Sep 16 17:51:31 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:31 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_wb_f04kbdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:31 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] 81ac455d-f592-4ef7-8c27-23e4054a633b was qcow2, converting to qcow2 {{(pid=85899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 16 17:51:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_wb_f04kbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:31 devstack sudo[100716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_wb_f04kbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8 Sep 16 17:51:31 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:33 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_wb_f04kbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8" returned: 0 in 1.932s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:33 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_81ac455d-f592-4ef7-8c27-23e4054a633b_wb_f04kbdevstack@QuobyteHD, size 112.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8 {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:51:33 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Converted 112.00 MB image at 57.92 MB/s Sep 16 17:51:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:33 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8 1G Sep 16 17:51:33 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:34 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8 1G" returned: 0 in 0.343s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:34 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Downloaded image 81ac455d-f592-4ef7-8c27-23e4054a633b ((None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}])) to volume 22d1e3a4-7fbc-4266-9dd9-900d3e865ed8 successfully. {{(pid=85899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 17:51:34 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Temporary image 81ac455d-f592-4ef7-8c27-23e4054a633b for user 7a58c88ae3814bcab0d8c11faddb0e6e is deleted. {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 16 17:51:34 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Marking volume 22d1e3a4-7fbc-4266-9dd9-900d3e865ed8 as bootable. {{(pid=85899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 17:51:34 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Copying metadata from image 81ac455d-f592-4ef7-8c27-23e4054a633b to 22d1e3a4-7fbc-4266-9dd9-900d3e865ed8. {{(pid=85899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 17:51:34 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Creating volume glance metadata for volume 22d1e3a4-7fbc-4266-9dd9-900d3e865ed8 backed by image 81ac455d-f592-4ef7-8c27-23e4054a633b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 17:51:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa00eef-053e-4284-a8c7-245e70ac9ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8', 'volume_size': 1, 'image_id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81ac455d-f592-4ef7-8c27-23e4054a633b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '124a9fc6f0b448c1afab7b2b666efe75', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81ac455d-f592-4ef7-8c27-23e4054a633b', 'created_at': datetime.datetime(2026, 9, 16, 15, 30, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 30, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81ac455d-f592-4ef7-8c27-23e4054a633b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a2b404-c434-448c-8da2-18ca0e3ed5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:34 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Volume volume-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8 (22d1e3a4-7fbc-4266-9dd9-900d3e865ed8): created successfully Sep 16 17:51:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a2b404-c434-448c-8da2-18ca0e3ed5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Flow 'volume_create_manager' (dc80b807-bce4-43ad-98d8-af55c4ccdfde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:51:34 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-df9f6d4c-4814-418a-b4ce-de31b5a4846d tempest-VolumesGetTest-575173115 None] Created volume successfully. Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Flow 'volume_create_manager' (dba8873a-bb37-4f6a-9741-99b27484e47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (352f84b0-9b07-425e-94e4-a1fb1d623b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (352f84b0-9b07-425e-94e4-a1fb1d623b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:51:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1516414215',display_name='tempest-VolumesGetTest-Volume-2131324792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7964744f-5252-492a-8259-9690b5440fd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676e5beb18534c0dada628efd21f4cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:51:35Z,use_quota=True,user_id='7a58c88ae3814bcab0d8c11faddb0e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8994469f-8f4d-4c49-92c1-9faf96ae5e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8994469f-8f4d-4c49-92c1-9faf96ae5e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae81898-0202-43b6-8b0c-bb40a9e1582a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae81898-0202-43b6-8b0c-bb40a9e1582a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7964744f-5252-492a-8259-9690b5440fd4', 'volume_name': 'volume-7964744f-5252-492a-8259-9690b5440fd4', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c827c910-75c3-42fd-a261-0474b104b8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c827c910-75c3-42fd-a261-0474b104b8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544528a2-d468-4815-886e-3c6edaa97cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:35 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Volume 7964744f-5252-492a-8259-9690b5440fd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7964744f-5252-492a-8259-9690b5440fd4', 'volume_size': 1} Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:51:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1516414215',display_name='tempest-VolumesGetTest-Volume-2131324792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7964744f-5252-492a-8259-9690b5440fd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676e5beb18534c0dada628efd21f4cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:51:35Z,use_quota=True,user_id='7a58c88ae3814bcab0d8c11faddb0e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Creating volume 7964744f-5252-492a-8259-9690b5440fd4 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:51:35 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7964744f-5252-492a-8259-9690b5440fd4 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:35 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7964744f-5252-492a-8259-9690b5440fd4 1073741824 Sep 16 17:51:35 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:35 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7964744f-5252-492a-8259-9690b5440fd4 1073741824" returned: 0 in 0.420s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7964744f-5252-492a-8259-9690b5440fd4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:35 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7964744f-5252-492a-8259-9690b5440fd4 Sep 16 17:51:35 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:36 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7964744f-5252-492a-8259-9690b5440fd4" returned: 0 in 0.262s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:36 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:51:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544528a2-d468-4815-886e-3c6edaa97cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7964744f-5252-492a-8259-9690b5440fd4', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8a0d73-fd36-4f9f-930b-e1eee4422221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:36 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Volume volume-7964744f-5252-492a-8259-9690b5440fd4 (7964744f-5252-492a-8259-9690b5440fd4): created successfully Sep 16 17:51:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8a0d73-fd36-4f9f-930b-e1eee4422221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Flow 'volume_create_manager' (dba8873a-bb37-4f6a-9741-99b27484e47d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:51:36 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-b39d5f7c-8352-45af-b8b8-3db872fe3c12 tempest-VolumesGetTest-575173115 None] Created volume successfully. Sep 16 17:51:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7e653c12-3562-4735-b7e1-c0cd7eaa887d tempest-VolumesGetTest-575173115 None] Acquiring lock "cinder-7964744f-5252-492a-8259-9690b5440fd4-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7e653c12-3562-4735-b7e1-c0cd7eaa887d tempest-VolumesGetTest-575173115 None] Lock "cinder-7964744f-5252-492a-8259-9690b5440fd4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7e653c12-3562-4735-b7e1-c0cd7eaa887d tempest-VolumesGetTest-575173115 None] Acquiring lock "cinder-quobyte-7964744f-5252-492a-8259-9690b5440fd4" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7e653c12-3562-4735-b7e1-c0cd7eaa887d tempest-VolumesGetTest-575173115 None] Lock "cinder-quobyte-7964744f-5252-492a-8259-9690b5440fd4" acquired by "delete_volume" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:36 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[593fe671-9824-4cb5-b89a-c6d96bd2fc54]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:51:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7e653c12-3562-4735-b7e1-c0cd7eaa887d tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7964744f-5252-492a-8259-9690b5440fd4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:36 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7964744f-5252-492a-8259-9690b5440fd4 Sep 16 17:51:36 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:36 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7e653c12-3562-4735-b7e1-c0cd7eaa887d tempest-VolumesGetTest-575173115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7964744f-5252-492a-8259-9690b5440fd4" returned: 0 in 0.373s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7e653c12-3562-4735-b7e1-c0cd7eaa887d tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7964744f-5252-492a-8259-9690b5440fd4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:36 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7964744f-5252-492a-8259-9690b5440fd4 Sep 16 17:51:36 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:37 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7e653c12-3562-4735-b7e1-c0cd7eaa887d tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7964744f-5252-492a-8259-9690b5440fd4" returned: 0 in 0.257s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7e653c12-3562-4735-b7e1-c0cd7eaa887d tempest-VolumesGetTest-575173115 None] Lock "cinder-quobyte-7964744f-5252-492a-8259-9690b5440fd4" released by "delete_volume" :: held 0.674s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:51:37 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-7e653c12-3562-4735-b7e1-c0cd7eaa887d tempest-VolumesGetTest-575173115 None] Created reservations ['bf2757c7-624b-4b54-8a37-3a59042ec073', 'f5c8bf4f-58ce-4633-8d27-5fb616892cfb', '0596ea2d-20dd-4537-8a50-0529a88aaef4', 'c8a59ca9-9316-44b1-b7df-206c0eda823e'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:51:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7e653c12-3562-4735-b7e1-c0cd7eaa887d tempest-VolumesGetTest-575173115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7e653c12-3562-4735-b7e1-c0cd7eaa887d tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:37 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7e653c12-3562-4735-b7e1-c0cd7eaa887d tempest-VolumesGetTest-575173115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:51:37 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7e653c12-3562-4735-b7e1-c0cd7eaa887d tempest-VolumesGetTest-575173115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:51:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7e653c12-3562-4735-b7e1-c0cd7eaa887d tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7e653c12-3562-4735-b7e1-c0cd7eaa887d tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:37 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:51:37 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:37 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7e653c12-3562-4735-b7e1-c0cd7eaa887d tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.279s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:37 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-7e653c12-3562-4735-b7e1-c0cd7eaa887d tempest-VolumesGetTest-575173115 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:51:37 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-7e653c12-3562-4735-b7e1-c0cd7eaa887d tempest-VolumesGetTest-575173115 None] Deleted volume successfully. Sep 16 17:51:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7e653c12-3562-4735-b7e1-c0cd7eaa887d tempest-VolumesGetTest-575173115 None] Lock "cinder-7964744f-5252-492a-8259-9690b5440fd4-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:51:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ebc38835-1d05-40e2-8fa7-784150779f3d tempest-VolumesGetTest-575173115 None] Acquiring lock "cinder-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ebc38835-1d05-40e2-8fa7-784150779f3d tempest-VolumesGetTest-575173115 None] Lock "cinder-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ebc38835-1d05-40e2-8fa7-784150779f3d tempest-VolumesGetTest-575173115 None] Acquiring lock "cinder-quobyte-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ebc38835-1d05-40e2-8fa7-784150779f3d tempest-VolumesGetTest-575173115 None] Lock "cinder-quobyte-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8" acquired by "delete_volume" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:37 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[587a290c-0be3-46af-8eeb-7ea92ed89a1c]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:51:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ebc38835-1d05-40e2-8fa7-784150779f3d tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:37 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8 Sep 16 17:51:37 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:38 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ebc38835-1d05-40e2-8fa7-784150779f3d tempest-VolumesGetTest-575173115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8" returned: 0 in 0.409s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ebc38835-1d05-40e2-8fa7-784150779f3d tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:38 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8 Sep 16 17:51:38 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:38 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ebc38835-1d05-40e2-8fa7-784150779f3d tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8" returned: 0 in 0.258s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ebc38835-1d05-40e2-8fa7-784150779f3d tempest-VolumesGetTest-575173115 None] Lock "cinder-quobyte-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8" released by "delete_volume" :: held 0.711s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:51:38 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-ebc38835-1d05-40e2-8fa7-784150779f3d tempest-VolumesGetTest-575173115 None] Created reservations ['1995122e-a433-4a2d-beaa-59df09ed8888', '00237d9a-7810-43f9-9491-fc924d21d95a', '69073884-75bb-41ea-a8ff-0d6a459c06dc', '733cb861-ce74-471e-9d59-04aaf365430f'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:51:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ebc38835-1d05-40e2-8fa7-784150779f3d tempest-VolumesGetTest-575173115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ebc38835-1d05-40e2-8fa7-784150779f3d tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ebc38835-1d05-40e2-8fa7-784150779f3d tempest-VolumesGetTest-575173115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:51:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ebc38835-1d05-40e2-8fa7-784150779f3d tempest-VolumesGetTest-575173115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:51:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ebc38835-1d05-40e2-8fa7-784150779f3d tempest-VolumesGetTest-575173115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ebc38835-1d05-40e2-8fa7-784150779f3d tempest-VolumesGetTest-575173115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:38 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:51:38 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:38 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ebc38835-1d05-40e2-8fa7-784150779f3d tempest-VolumesGetTest-575173115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.275s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:38 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-ebc38835-1d05-40e2-8fa7-784150779f3d tempest-VolumesGetTest-575173115 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:51:38 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-ebc38835-1d05-40e2-8fa7-784150779f3d tempest-VolumesGetTest-575173115 None] Deleted volume successfully. Sep 16 17:51:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ebc38835-1d05-40e2-8fa7-784150779f3d tempest-VolumesGetTest-575173115 None] Lock "cinder-22d1e3a4-7fbc-4266-9dd9-900d3e865ed8-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:51:42 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:51:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Flow 'volume_create_manager' (05bd5acd-1494-4847-9f08-e3ae582eabb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:51:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4001f1a6-2b09-4424-b310-3df02fe6b026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4001f1a6-2b09-4424-b310-3df02fe6b026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1932646616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18adf69-ea0b-4e05-b855-103fcf9980ff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7286ee303dc5487b9bc15f50c306140b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:51:43Z,use_quota=True,user_id='f748949e003340b5abcfb74c550e5f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc44d63-8b65-48d0-adb8-cbd1fe6d7012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc44d63-8b65-48d0-adb8-cbd1fe6d7012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4cd7be0-a6c2-4a86-ac86-77ca58dc32df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4cd7be0-a6c2-4a86-ac86-77ca58dc32df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f18adf69-ea0b-4e05-b855-103fcf9980ff', 'volume_name': 'volume-f18adf69-ea0b-4e05-b855-103fcf9980ff', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e81019-0ff8-4d05-8a01-6f942eb3ea37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e81019-0ff8-4d05-8a01-6f942eb3ea37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50dfddea-a9ad-4811-8018-83cd0c47d6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:42 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Volume f18adf69-ea0b-4e05-b855-103fcf9980ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f18adf69-ea0b-4e05-b855-103fcf9980ff', 'volume_size': 1} Sep 16 17:51:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1932646616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18adf69-ea0b-4e05-b855-103fcf9980ff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7286ee303dc5487b9bc15f50c306140b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:51:43Z,use_quota=True,user_id='f748949e003340b5abcfb74c550e5f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:51:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Creating volume f18adf69-ea0b-4e05-b855-103fcf9980ff {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:51:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:51:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:51:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:51:42 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:51:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f18adf69-ea0b-4e05-b855-103fcf9980ff 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:42 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f18adf69-ea0b-4e05-b855-103fcf9980ff 1073741824 Sep 16 17:51:42 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:43 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f18adf69-ea0b-4e05-b855-103fcf9980ff 1073741824" returned: 0 in 0.438s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f18adf69-ea0b-4e05-b855-103fcf9980ff {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:43 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f18adf69-ea0b-4e05-b855-103fcf9980ff Sep 16 17:51:43 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:43 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f18adf69-ea0b-4e05-b855-103fcf9980ff" returned: 0 in 0.267s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:51:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50dfddea-a9ad-4811-8018-83cd0c47d6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f18adf69-ea0b-4e05-b855-103fcf9980ff', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4062eb8c-030d-425d-b1c1-8041933c064d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:43 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Volume volume-f18adf69-ea0b-4e05-b855-103fcf9980ff (f18adf69-ea0b-4e05-b855-103fcf9980ff): created successfully Sep 16 17:51:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4062eb8c-030d-425d-b1c1-8041933c064d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Flow 'volume_create_manager' (05bd5acd-1494-4847-9f08-e3ae582eabb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:51:43 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-e6b608e0-4ecc-4123-8412-b46c9e9ae66d tempest-VolumesListTestJSON-604815899 None] Created volume successfully. Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Flow 'volume_create_manager' (eb9c3010-eb76-44c6-b195-e97a8c2e081c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf186a60-38e0-4c13-9b21-36a4b2c363c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf186a60-38e0-4c13-9b21-36a4b2c363c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1292411884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7286ee303dc5487b9bc15f50c306140b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:51:44Z,use_quota=True,user_id='f748949e003340b5abcfb74c550e5f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44503419-cdbb-489a-b5f7-932577bc9b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44503419-cdbb-489a-b5f7-932577bc9b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c9eda7-1c13-475c-9b1f-134b441eef8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c9eda7-1c13-475c-9b1f-134b441eef8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924', 'volume_name': 'volume-5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87bcc537-b7a5-4f64-b01c-53e2f004a1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87bcc537-b7a5-4f64-b01c-53e2f004a1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039f8f0d-6cae-4803-aab4-b182eda8ad07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:44 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Volume 5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924', 'volume_size': 1} Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1292411884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7286ee303dc5487b9bc15f50c306140b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:51:44Z,use_quota=True,user_id='f748949e003340b5abcfb74c550e5f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Creating volume 5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:51:44 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:44 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924 1073741824 Sep 16 17:51:44 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:44 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924 1073741824" returned: 0 in 0.423s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:44 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924 Sep 16 17:51:44 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:45 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924" returned: 0 in 0.275s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039f8f0d-6cae-4803-aab4-b182eda8ad07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4adbf30b-d819-437e-95b4-2721aac9accc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:45 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Volume volume-5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924 (5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924): created successfully Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4adbf30b-d819-437e-95b4-2721aac9accc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Flow 'volume_create_manager' (eb9c3010-eb76-44c6-b195-e97a8c2e081c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:51:45 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-c5c0c7dd-ebde-4863-ad0f-2713867e657f tempest-VolumesListTestJSON-604815899 None] Created volume successfully. Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Flow 'volume_create_manager' (df21a0c1-4c5d-48f9-9ab2-bc91c38e4688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f21e16-f167-4ec0-9248-34699631fa57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f21e16-f167-4ec0-9248-34699631fa57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1019502434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea00def-aa70-4205-958d-2cf060ec31f6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7286ee303dc5487b9bc15f50c306140b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:51:46Z,use_quota=True,user_id='f748949e003340b5abcfb74c550e5f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760ec991-2d15-4ecb-8724-9189ea8e1dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760ec991-2d15-4ecb-8724-9189ea8e1dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c47e4d90-68f0-4ed0-af66-0d7bc5436b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c47e4d90-68f0-4ed0-af66-0d7bc5436b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ea00def-aa70-4205-958d-2cf060ec31f6', 'volume_name': 'volume-6ea00def-aa70-4205-958d-2cf060ec31f6', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c30412e-db27-49b7-be61-6c83a388b0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c30412e-db27-49b7-be61-6c83a388b0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebcbcef6-f796-44a0-9db0-9c68662789e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:45 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Volume 6ea00def-aa70-4205-958d-2cf060ec31f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ea00def-aa70-4205-958d-2cf060ec31f6', 'volume_size': 1} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1019502434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea00def-aa70-4205-958d-2cf060ec31f6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7286ee303dc5487b9bc15f50c306140b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:51:46Z,use_quota=True,user_id='f748949e003340b5abcfb74c550e5f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Creating volume 6ea00def-aa70-4205-958d-2cf060ec31f6 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:51:45 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:51:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6ea00def-aa70-4205-958d-2cf060ec31f6 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:45 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6ea00def-aa70-4205-958d-2cf060ec31f6 1073741824 Sep 16 17:51:45 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:46 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6ea00def-aa70-4205-958d-2cf060ec31f6 1073741824" returned: 0 in 0.513s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6ea00def-aa70-4205-958d-2cf060ec31f6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:46 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6ea00def-aa70-4205-958d-2cf060ec31f6 Sep 16 17:51:46 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:46 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6ea00def-aa70-4205-958d-2cf060ec31f6" returned: 0 in 0.310s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:51:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebcbcef6-f796-44a0-9db0-9c68662789e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ea00def-aa70-4205-958d-2cf060ec31f6', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a78fa9-0958-4bdf-9f36-17b7598c00fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:46 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Volume volume-6ea00def-aa70-4205-958d-2cf060ec31f6 (6ea00def-aa70-4205-958d-2cf060ec31f6): created successfully Sep 16 17:51:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a78fa9-0958-4bdf-9f36-17b7598c00fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Flow 'volume_create_manager' (df21a0c1-4c5d-48f9-9ab2-bc91c38e4688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:51:46 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-c5e88dc4-e6f2-4b08-b9eb-17e745f9f333 tempest-VolumesListTestJSON-604815899 None] Created volume successfully. Sep 16 17:51:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0d7351d8-3d87-4577-9df0-aac59cf803bd tempest-VolumesListTestJSON-604815899 None] Acquiring lock "cinder-6ea00def-aa70-4205-958d-2cf060ec31f6-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0d7351d8-3d87-4577-9df0-aac59cf803bd tempest-VolumesListTestJSON-604815899 None] Lock "cinder-6ea00def-aa70-4205-958d-2cf060ec31f6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0d7351d8-3d87-4577-9df0-aac59cf803bd tempest-VolumesListTestJSON-604815899 None] Acquiring lock "cinder-quobyte-6ea00def-aa70-4205-958d-2cf060ec31f6" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0d7351d8-3d87-4577-9df0-aac59cf803bd tempest-VolumesListTestJSON-604815899 None] Lock "cinder-quobyte-6ea00def-aa70-4205-958d-2cf060ec31f6" acquired by "delete_volume" :: waited 0.026s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:50 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[24056082-4a1e-4e72-9b1c-d2bbfd9da7dc]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:51:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0d7351d8-3d87-4577-9df0-aac59cf803bd tempest-VolumesListTestJSON-604815899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6ea00def-aa70-4205-958d-2cf060ec31f6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:50 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6ea00def-aa70-4205-958d-2cf060ec31f6 Sep 16 17:51:50 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:50 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0d7351d8-3d87-4577-9df0-aac59cf803bd tempest-VolumesListTestJSON-604815899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6ea00def-aa70-4205-958d-2cf060ec31f6" returned: 0 in 0.378s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0d7351d8-3d87-4577-9df0-aac59cf803bd tempest-VolumesListTestJSON-604815899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6ea00def-aa70-4205-958d-2cf060ec31f6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:50 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6ea00def-aa70-4205-958d-2cf060ec31f6 Sep 16 17:51:50 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:50 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0d7351d8-3d87-4577-9df0-aac59cf803bd tempest-VolumesListTestJSON-604815899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6ea00def-aa70-4205-958d-2cf060ec31f6" returned: 0 in 0.266s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0d7351d8-3d87-4577-9df0-aac59cf803bd tempest-VolumesListTestJSON-604815899 None] Lock "cinder-quobyte-6ea00def-aa70-4205-958d-2cf060ec31f6" released by "delete_volume" :: held 0.686s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:51:50 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-0d7351d8-3d87-4577-9df0-aac59cf803bd tempest-VolumesListTestJSON-604815899 None] Created reservations ['3cdad477-65f8-425d-9df0-3c8fcf0e63d4', '658fda8d-3d36-4859-9f9e-8568bc9f322c', '810db004-5cc8-4adc-824d-25a6d0779440', 'd88b0748-147d-4354-bcc5-bdab42641b1b'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:51:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0d7351d8-3d87-4577-9df0-aac59cf803bd tempest-VolumesListTestJSON-604815899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0d7351d8-3d87-4577-9df0-aac59cf803bd tempest-VolumesListTestJSON-604815899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0d7351d8-3d87-4577-9df0-aac59cf803bd tempest-VolumesListTestJSON-604815899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:51:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0d7351d8-3d87-4577-9df0-aac59cf803bd tempest-VolumesListTestJSON-604815899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:51:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0d7351d8-3d87-4577-9df0-aac59cf803bd tempest-VolumesListTestJSON-604815899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0d7351d8-3d87-4577-9df0-aac59cf803bd tempest-VolumesListTestJSON-604815899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:51 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:51:51 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:51 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0d7351d8-3d87-4577-9df0-aac59cf803bd tempest-VolumesListTestJSON-604815899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.290s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:51 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-0d7351d8-3d87-4577-9df0-aac59cf803bd tempest-VolumesListTestJSON-604815899 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:51:51 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-0d7351d8-3d87-4577-9df0-aac59cf803bd tempest-VolumesListTestJSON-604815899 None] Deleted volume successfully. Sep 16 17:51:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-0d7351d8-3d87-4577-9df0-aac59cf803bd tempest-VolumesListTestJSON-604815899 None] Lock "cinder-6ea00def-aa70-4205-958d-2cf060ec31f6-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:51:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-425bc638-f652-4fee-9387-7531d139a3f4 tempest-VolumesListTestJSON-604815899 None] Acquiring lock "cinder-5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-425bc638-f652-4fee-9387-7531d139a3f4 tempest-VolumesListTestJSON-604815899 None] Lock "cinder-5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-425bc638-f652-4fee-9387-7531d139a3f4 tempest-VolumesListTestJSON-604815899 None] Acquiring lock "cinder-quobyte-5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-425bc638-f652-4fee-9387-7531d139a3f4 tempest-VolumesListTestJSON-604815899 None] Lock "cinder-quobyte-5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924" acquired by "delete_volume" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:51 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[010c6775-fa21-4eef-b286-812ff0e41f3e]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:51:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-425bc638-f652-4fee-9387-7531d139a3f4 tempest-VolumesListTestJSON-604815899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:51 devstack sudo[100864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924 Sep 16 17:51:51 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:51 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-425bc638-f652-4fee-9387-7531d139a3f4 tempest-VolumesListTestJSON-604815899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924" returned: 0 in 0.444s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-425bc638-f652-4fee-9387-7531d139a3f4 tempest-VolumesListTestJSON-604815899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:52 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924 Sep 16 17:51:52 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:52 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-425bc638-f652-4fee-9387-7531d139a3f4 tempest-VolumesListTestJSON-604815899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924" returned: 0 in 0.282s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-425bc638-f652-4fee-9387-7531d139a3f4 tempest-VolumesListTestJSON-604815899 None] Lock "cinder-quobyte-5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924" released by "delete_volume" :: held 0.781s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Flow 'volume_create_manager' (05c8eef0-6e31-4fdb-8cc1-dcac0d86d0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ead4c0-20f6-42f6-a901-3bb95c905d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ead4c0-20f6-42f6-a901-3bb95c905d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1654670784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1303b4b8-a708-4d29-ae7e-79d43589048d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b64be895e89a43eb9e2da37c31782731',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:51:52Z,use_quota=True,user_id='6a5a0ab1c25c4f5db5982f36225fa7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (613fa898-748d-43fb-8082-026977466a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (613fa898-748d-43fb-8082-026977466a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d8376d-fe01-4c36-a570-b5087803938f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d8376d-fe01-4c36-a570-b5087803938f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1303b4b8-a708-4d29-ae7e-79d43589048d', 'volume_name': 'volume-1303b4b8-a708-4d29-ae7e-79d43589048d', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae247b1-c6fb-43df-a892-64e1a4547421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae247b1-c6fb-43df-a892-64e1a4547421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094a0224-28a6-4802-95ce-1d8cdda9fef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:52 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Volume 1303b4b8-a708-4d29-ae7e-79d43589048d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1303b4b8-a708-4d29-ae7e-79d43589048d', 'volume_size': 1} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1654670784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1303b4b8-a708-4d29-ae7e-79d43589048d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b64be895e89a43eb9e2da37c31782731',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:51:52Z,use_quota=True,user_id='6a5a0ab1c25c4f5db5982f36225fa7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Creating volume 1303b4b8-a708-4d29-ae7e-79d43589048d {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:51:52 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1303b4b8-a708-4d29-ae7e-79d43589048d 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:52 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1303b4b8-a708-4d29-ae7e-79d43589048d 1073741824 Sep 16 17:51:52 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-425bc638-f652-4fee-9387-7531d139a3f4 tempest-VolumesListTestJSON-604815899 None] Created reservations ['b92c0e56-9e9c-4bd2-91e8-603f607772a9', '341e6ce2-24ff-40e7-aea9-4f3df50f5edd', '998a600b-9ee8-47e8-8e27-f17e229b730c', '80a95007-37a3-45e0-b7d5-25095089af7a'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-425bc638-f652-4fee-9387-7531d139a3f4 tempest-VolumesListTestJSON-604815899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-425bc638-f652-4fee-9387-7531d139a3f4 tempest-VolumesListTestJSON-604815899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-425bc638-f652-4fee-9387-7531d139a3f4 tempest-VolumesListTestJSON-604815899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-425bc638-f652-4fee-9387-7531d139a3f4 tempest-VolumesListTestJSON-604815899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-425bc638-f652-4fee-9387-7531d139a3f4 tempest-VolumesListTestJSON-604815899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-425bc638-f652-4fee-9387-7531d139a3f4 tempest-VolumesListTestJSON-604815899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:52 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:51:52 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-10b2fd71-a670-4b0b-8fe5-91bcf145a4b7 tempest-VolumesListTestJSON-604815899 None] Acquiring lock "cinder-f18adf69-ea0b-4e05-b855-103fcf9980ff-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-10b2fd71-a670-4b0b-8fe5-91bcf145a4b7 tempest-VolumesListTestJSON-604815899 None] Lock "cinder-f18adf69-ea0b-4e05-b855-103fcf9980ff-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-10b2fd71-a670-4b0b-8fe5-91bcf145a4b7 tempest-VolumesListTestJSON-604815899 None] Acquiring lock "cinder-quobyte-f18adf69-ea0b-4e05-b855-103fcf9980ff" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-10b2fd71-a670-4b0b-8fe5-91bcf145a4b7 tempest-VolumesListTestJSON-604815899 None] Lock "cinder-quobyte-f18adf69-ea0b-4e05-b855-103fcf9980ff" acquired by "delete_volume" :: waited 0.023s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5427487-95be-4005-ab31-a7e4159e107b]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-10b2fd71-a670-4b0b-8fe5-91bcf145a4b7 tempest-VolumesListTestJSON-604815899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f18adf69-ea0b-4e05-b855-103fcf9980ff {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:52 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-425bc638-f652-4fee-9387-7531d139a3f4 tempest-VolumesListTestJSON-604815899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.323s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-425bc638-f652-4fee-9387-7531d139a3f4 tempest-VolumesListTestJSON-604815899 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:51:52 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-425bc638-f652-4fee-9387-7531d139a3f4 tempest-VolumesListTestJSON-604815899 None] Deleted volume successfully. Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-425bc638-f652-4fee-9387-7531d139a3f4 tempest-VolumesListTestJSON-604815899 None] Lock "cinder-5ee1f5cd-e56e-4b27-9a0b-b4bc3558b924-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:51:52 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1303b4b8-a708-4d29-ae7e-79d43589048d 1073741824" returned: 0 in 0.508s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:52 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f18adf69-ea0b-4e05-b855-103fcf9980ff Sep 16 17:51:52 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1303b4b8-a708-4d29-ae7e-79d43589048d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:52 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1303b4b8-a708-4d29-ae7e-79d43589048d Sep 16 17:51:52 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:53 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1303b4b8-a708-4d29-ae7e-79d43589048d" returned: 0 in 0.276s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:51:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094a0224-28a6-4802-95ce-1d8cdda9fef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1303b4b8-a708-4d29-ae7e-79d43589048d', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:53 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23cb0087-7b32-40ef-887b-e73cf446679a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-10b2fd71-a670-4b0b-8fe5-91bcf145a4b7 tempest-VolumesListTestJSON-604815899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f18adf69-ea0b-4e05-b855-103fcf9980ff" returned: 0 in 0.431s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-10b2fd71-a670-4b0b-8fe5-91bcf145a4b7 tempest-VolumesListTestJSON-604815899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f18adf69-ea0b-4e05-b855-103fcf9980ff {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:53 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Volume volume-1303b4b8-a708-4d29-ae7e-79d43589048d (1303b4b8-a708-4d29-ae7e-79d43589048d): created successfully Sep 16 17:51:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23cb0087-7b32-40ef-887b-e73cf446679a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:53 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f18adf69-ea0b-4e05-b855-103fcf9980ff Sep 16 17:51:53 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Flow 'volume_create_manager' (05c8eef0-6e31-4fdb-8cc1-dcac0d86d0f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:51:53 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-a1f27b54-7da2-4ec3-80da-37c222b9b1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Created volume successfully. Sep 16 17:51:53 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-10b2fd71-a670-4b0b-8fe5-91bcf145a4b7 tempest-VolumesListTestJSON-604815899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f18adf69-ea0b-4e05-b855-103fcf9980ff" returned: 0 in 0.251s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:53 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-10b2fd71-a670-4b0b-8fe5-91bcf145a4b7 tempest-VolumesListTestJSON-604815899 None] Lock "cinder-quobyte-f18adf69-ea0b-4e05-b855-103fcf9980ff" released by "delete_volume" :: held 0.726s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:51:53 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-10b2fd71-a670-4b0b-8fe5-91bcf145a4b7 tempest-VolumesListTestJSON-604815899 None] Created reservations ['4fd095b4-cb72-4daa-8088-dd6ca2240967', '67d349b4-f7f2-4ccc-8bc5-d4a85b04f7be', '6717fcfa-8ecc-4acc-9f2b-fec45794fe28', '9e63ddeb-fb6e-409c-8d08-5f170ff04c39'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:51:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-10b2fd71-a670-4b0b-8fe5-91bcf145a4b7 tempest-VolumesListTestJSON-604815899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-10b2fd71-a670-4b0b-8fe5-91bcf145a4b7 tempest-VolumesListTestJSON-604815899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-10b2fd71-a670-4b0b-8fe5-91bcf145a4b7 tempest-VolumesListTestJSON-604815899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:51:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-10b2fd71-a670-4b0b-8fe5-91bcf145a4b7 tempest-VolumesListTestJSON-604815899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:51:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-10b2fd71-a670-4b0b-8fe5-91bcf145a4b7 tempest-VolumesListTestJSON-604815899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-10b2fd71-a670-4b0b-8fe5-91bcf145a4b7 tempest-VolumesListTestJSON-604815899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:53 devstack sudo[100893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:51:53 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:53 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-10b2fd71-a670-4b0b-8fe5-91bcf145a4b7 tempest-VolumesListTestJSON-604815899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.263s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:53 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-10b2fd71-a670-4b0b-8fe5-91bcf145a4b7 tempest-VolumesListTestJSON-604815899 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:51:53 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-10b2fd71-a670-4b0b-8fe5-91bcf145a4b7 tempest-VolumesListTestJSON-604815899 None] Deleted volume successfully. Sep 16 17:51:53 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-10b2fd71-a670-4b0b-8fe5-91bcf145a4b7 tempest-VolumesListTestJSON-604815899 None] Lock "cinder-f18adf69-ea0b-4e05-b855-103fcf9980ff-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:51:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-e05b2359-6fde-4d36-8644-3b29c132562f req-c038a873-97f4-49ba-bcaf-b59e4241bb50 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-e05b2359-6fde-4d36-8644-3b29c132562f req-c038a873-97f4-49ba-bcaf-b59e4241bb50 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-e05b2359-6fde-4d36-8644-3b29c132562f req-c038a873-97f4-49ba-bcaf-b59e4241bb50 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:55 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-e05b2359-6fde-4d36-8644-3b29c132562f req-c038a873-97f4-49ba-bcaf-b59e4241bb50 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7', 'name': 'volume-1303b4b8-a708-4d29-ae7e-79d43589048d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1648f022-b31b-440c-907e-4cd21f11ef12', 'enforce_multipath': True} {{(pid=85899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4920}} Sep 16 17:51:55 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-e05b2359-6fde-4d36-8644-3b29c132562f req-c038a873-97f4-49ba-bcaf-b59e4241bb50 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] attachment_update completed successfully. Sep 16 17:51:57 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:51:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Flow 'volume_create_manager' (5dd5f1fe-8597-47f3-b7a9-8486c96fdb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:51:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379a73f1-c943-4307-9162-d0602f72c9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379a73f1-c943-4307-9162-d0602f72c9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1561061280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ced0d15-dad5-45c9-a950-29c3f4ac6c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2424f62318e648a28c1713c84e434076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:51:58Z,use_quota=True,user_id='fb685b0b7b18452e8631fcc72349f18d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65bff57d-0e24-4d29-a48a-5009d9a85c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65bff57d-0e24-4d29-a48a-5009d9a85c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263977a2-9e4a-444d-a39e-809949f5231b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263977a2-9e4a-444d-a39e-809949f5231b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ced0d15-dad5-45c9-a950-29c3f4ac6c26', 'volume_name': 'volume-1ced0d15-dad5-45c9-a950-29c3f4ac6c26', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1600c144-7c2d-4601-a353-4304df212ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1600c144-7c2d-4601-a353-4304df212ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe12794a-a6e2-43fc-ada1-69cb6b505c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:57 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Volume 1ced0d15-dad5-45c9-a950-29c3f4ac6c26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ced0d15-dad5-45c9-a950-29c3f4ac6c26', 'volume_size': 1} Sep 16 17:51:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1561061280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ced0d15-dad5-45c9-a950-29c3f4ac6c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2424f62318e648a28c1713c84e434076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:51:58Z,use_quota=True,user_id='fb685b0b7b18452e8631fcc72349f18d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:51:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Creating volume 1ced0d15-dad5-45c9-a950-29c3f4ac6c26 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:51:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:51:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:51:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:51:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:51:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:51:57 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:51:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1ced0d15-dad5-45c9-a950-29c3f4ac6c26 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:57 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1ced0d15-dad5-45c9-a950-29c3f4ac6c26 1073741824 Sep 16 17:51:57 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:58 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1ced0d15-dad5-45c9-a950-29c3f4ac6c26 1073741824" returned: 0 in 0.476s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1ced0d15-dad5-45c9-a950-29c3f4ac6c26 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:58 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1ced0d15-dad5-45c9-a950-29c3f4ac6c26 Sep 16 17:51:58 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:51:58 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Sep 16 17:51:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1ced0d15-dad5-45c9-a950-29c3f4ac6c26" returned: 0 in 0.287s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:51:58 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:51:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:51:58 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe12794a-a6e2-43fc-ada1-69cb6b505c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ced0d15-dad5-45c9-a950-29c3f4ac6c26', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:58 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a7b17fe-495d-48b0-a236-ca8363a68765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:51:58 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Volume volume-1ced0d15-dad5-45c9-a950-29c3f4ac6c26 (1ced0d15-dad5-45c9-a950-29c3f4ac6c26): created successfully Sep 16 17:51:58 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a7b17fe-495d-48b0-a236-ca8363a68765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:51:58 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Flow 'volume_create_manager' (5dd5f1fe-8597-47f3-b7a9-8486c96fdb13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:51:58 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-d59bf817-a2d3-405a-bc15-c8058dd0f95f tempest-VolumesNegativeTest-1398948266 None] Created volume successfully. Sep 16 17:51:58 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-3fec6dfb-8b37-4e34-a38e-8151285ce349 req-814fa967-e61d-4aea-9de0-327b2fd9afc1 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Terminate volume connection completed successfully. Sep 16 17:51:58 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-3fec6dfb-8b37-4e34-a38e-8151285ce349 req-814fa967-e61d-4aea-9de0-327b2fd9afc1 tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Deleting attachment 1648f022-b31b-440c-907e-4cd21f11ef12. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:51:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-33fe95a0-2e18-44a1-bfb7-c1c53714ef6e tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Acquiring lock "cinder-1303b4b8-a708-4d29-ae7e-79d43589048d-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-33fe95a0-2e18-44a1-bfb7-c1c53714ef6e tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Lock "cinder-1303b4b8-a708-4d29-ae7e-79d43589048d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-33fe95a0-2e18-44a1-bfb7-c1c53714ef6e tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Acquiring lock "cinder-quobyte-1303b4b8-a708-4d29-ae7e-79d43589048d" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:51:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-33fe95a0-2e18-44a1-bfb7-c1c53714ef6e tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Lock "cinder-quobyte-1303b4b8-a708-4d29-ae7e-79d43589048d" acquired by "delete_volume" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:51:59 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0ff9d1-38b2-445c-88c7-603e15effa06]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:51:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-33fe95a0-2e18-44a1-bfb7-c1c53714ef6e tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1303b4b8-a708-4d29-ae7e-79d43589048d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:51:59 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1303b4b8-a708-4d29-ae7e-79d43589048d Sep 16 17:51:59 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:52:00 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Sep 16 17:52:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-33fe95a0-2e18-44a1-bfb7-c1c53714ef6e tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1303b4b8-a708-4d29-ae7e-79d43589048d" returned: 0 in 0.411s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:52:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-33fe95a0-2e18-44a1-bfb7-c1c53714ef6e tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1303b4b8-a708-4d29-ae7e-79d43589048d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:52:00 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1303b4b8-a708-4d29-ae7e-79d43589048d Sep 16 17:52:00 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:52:00 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Sep 16 17:52:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-33fe95a0-2e18-44a1-bfb7-c1c53714ef6e tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1303b4b8-a708-4d29-ae7e-79d43589048d" returned: 0 in 0.275s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:52:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-33fe95a0-2e18-44a1-bfb7-c1c53714ef6e tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Lock "cinder-quobyte-1303b4b8-a708-4d29-ae7e-79d43589048d" released by "delete_volume" :: held 0.735s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:52:00 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-33fe95a0-2e18-44a1-bfb7-c1c53714ef6e tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Created reservations ['029b662f-63a4-47a6-85d5-a6a87489c934', 'c3a432c8-cd54-4519-8bcf-f7441310255d', 'dff65c55-8e99-476b-a360-c60e3cea7696', '6cc321a7-7757-400d-bfc9-cf47051bdb87'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:52:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-33fe95a0-2e18-44a1-bfb7-c1c53714ef6e tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:52:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-33fe95a0-2e18-44a1-bfb7-c1c53714ef6e tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:52:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-33fe95a0-2e18-44a1-bfb7-c1c53714ef6e tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:52:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-33fe95a0-2e18-44a1-bfb7-c1c53714ef6e tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:52:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-33fe95a0-2e18-44a1-bfb7-c1c53714ef6e tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:52:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-33fe95a0-2e18-44a1-bfb7-c1c53714ef6e tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:52:00 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:52:00 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:52:00 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Sep 16 17:52:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-33fe95a0-2e18-44a1-bfb7-c1c53714ef6e tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.272s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:52:00 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-33fe95a0-2e18-44a1-bfb7-c1c53714ef6e tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:52:00 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-33fe95a0-2e18-44a1-bfb7-c1c53714ef6e tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Deleted volume successfully. Sep 16 17:52:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-33fe95a0-2e18-44a1-bfb7-c1c53714ef6e tempest-TestServerVolumeAttachScenarioOldVersion-1306863738 None] Lock "cinder-1303b4b8-a708-4d29-ae7e-79d43589048d-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:52:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:52:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:52:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:52:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:52:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:52:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:52:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:52:02 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:52:02 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:52:02 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Sep 16 17:52:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.389s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:52:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:52:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager._thread_info {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:52:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread count: 28 {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:52:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread info: [<_MainThread(MainThread, started 123748124422272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:52:10 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=86,cinder:INSERT=35,cinder:UPDATE=119,cinder:DELETE=5 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:52:10 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=90,cinder:INSERT=30,cinder:UPDATE=110,cinder:DELETE=15 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:52:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-19813b2b-fb49-4f6f-8097-6a191073ead9 tempest-VolumesNegativeTest-1398948266 None] Acquiring lock "cinder-1ced0d15-dad5-45c9-a950-29c3f4ac6c26-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:52:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-19813b2b-fb49-4f6f-8097-6a191073ead9 tempest-VolumesNegativeTest-1398948266 None] Lock "cinder-1ced0d15-dad5-45c9-a950-29c3f4ac6c26-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:52:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-19813b2b-fb49-4f6f-8097-6a191073ead9 tempest-VolumesNegativeTest-1398948266 None] Acquiring lock "cinder-quobyte-1ced0d15-dad5-45c9-a950-29c3f4ac6c26" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:52:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-19813b2b-fb49-4f6f-8097-6a191073ead9 tempest-VolumesNegativeTest-1398948266 None] Lock "cinder-quobyte-1ced0d15-dad5-45c9-a950-29c3f4ac6c26" acquired by "delete_volume" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:52:17 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b2fb7c-cf56-4466-a7f9-65800206adf8]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:52:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-19813b2b-fb49-4f6f-8097-6a191073ead9 tempest-VolumesNegativeTest-1398948266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1ced0d15-dad5-45c9-a950-29c3f4ac6c26 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:52:18 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1ced0d15-dad5-45c9-a950-29c3f4ac6c26 Sep 16 17:52:18 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:52:18 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Sep 16 17:52:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-19813b2b-fb49-4f6f-8097-6a191073ead9 tempest-VolumesNegativeTest-1398948266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1ced0d15-dad5-45c9-a950-29c3f4ac6c26" returned: 0 in 0.428s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:52:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-19813b2b-fb49-4f6f-8097-6a191073ead9 tempest-VolumesNegativeTest-1398948266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1ced0d15-dad5-45c9-a950-29c3f4ac6c26 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:52:18 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1ced0d15-dad5-45c9-a950-29c3f4ac6c26 Sep 16 17:52:18 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:52:18 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Sep 16 17:52:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-19813b2b-fb49-4f6f-8097-6a191073ead9 tempest-VolumesNegativeTest-1398948266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1ced0d15-dad5-45c9-a950-29c3f4ac6c26" returned: 0 in 0.286s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:52:18 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-19813b2b-fb49-4f6f-8097-6a191073ead9 tempest-VolumesNegativeTest-1398948266 None] Lock "cinder-quobyte-1ced0d15-dad5-45c9-a950-29c3f4ac6c26" released by "delete_volume" :: held 0.771s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:52:18 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-19813b2b-fb49-4f6f-8097-6a191073ead9 tempest-VolumesNegativeTest-1398948266 None] Created reservations ['4ba9b094-dc03-4d30-9a9a-23e98631a2f4', '8f3c1730-ee83-491a-b2ad-06617d47a0c3', 'aa9007bd-0c24-4536-8444-814314e1f3f8', '8b617ce1-b7b0-42fb-a3dc-70e158b6d6e4'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:52:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-19813b2b-fb49-4f6f-8097-6a191073ead9 tempest-VolumesNegativeTest-1398948266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:52:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-19813b2b-fb49-4f6f-8097-6a191073ead9 tempest-VolumesNegativeTest-1398948266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:52:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-19813b2b-fb49-4f6f-8097-6a191073ead9 tempest-VolumesNegativeTest-1398948266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:52:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-19813b2b-fb49-4f6f-8097-6a191073ead9 tempest-VolumesNegativeTest-1398948266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:52:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-19813b2b-fb49-4f6f-8097-6a191073ead9 tempest-VolumesNegativeTest-1398948266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:52:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-19813b2b-fb49-4f6f-8097-6a191073ead9 tempest-VolumesNegativeTest-1398948266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:52:18 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:52:18 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:52:19 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Sep 16 17:52:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-19813b2b-fb49-4f6f-8097-6a191073ead9 tempest-VolumesNegativeTest-1398948266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.317s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:52:19 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-19813b2b-fb49-4f6f-8097-6a191073ead9 tempest-VolumesNegativeTest-1398948266 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:52:19 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-19813b2b-fb49-4f6f-8097-6a191073ead9 tempest-VolumesNegativeTest-1398948266 None] Deleted volume successfully. Sep 16 17:52:19 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-19813b2b-fb49-4f6f-8097-6a191073ead9 tempest-VolumesNegativeTest-1398948266 None] Lock "cinder-1ced0d15-dad5-45c9-a950-29c3f4ac6c26-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:52:28 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:UPDATE=10,cinder:SELECT=4,cinder:INSERT=2 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:52:29 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Flow 'volume_create_manager' (3bfe5a94-86cb-4eb3-8984-5597f740326d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90685a3f-dc5b-4e0d-90ff-d3a753a8ce0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90685a3f-dc5b-4e0d-90ff-d3a753a8ce0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-205379555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de87916e-117b-4751-b30d-e1f61a1adcc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effd3b6310564353bbf45c2425d83ba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:52:42Z,use_quota=True,user_id='b08012c0ba024d3bb6cee4d830f9ff26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97763a44-b348-423b-b184-686c46ac5eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97763a44-b348-423b-b184-686c46ac5eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc414c7-e08c-41b0-846f-b58a3b93807d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc414c7-e08c-41b0-846f-b58a3b93807d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de87916e-117b-4751-b30d-e1f61a1adcc3', 'volume_name': 'volume-de87916e-117b-4751-b30d-e1f61a1adcc3', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc2d1b6e-96ec-4147-8f06-8c86caca20f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc2d1b6e-96ec-4147-8f06-8c86caca20f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844b2e77-8b34-4bb2-b759-0b39f5a5f82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:52:42 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Volume de87916e-117b-4751-b30d-e1f61a1adcc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de87916e-117b-4751-b30d-e1f61a1adcc3', 'volume_size': 1} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-205379555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de87916e-117b-4751-b30d-e1f61a1adcc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effd3b6310564353bbf45c2425d83ba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:52:42Z,use_quota=True,user_id='b08012c0ba024d3bb6cee4d830f9ff26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Creating volume de87916e-117b-4751-b30d-e1f61a1adcc3 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:52:42 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de87916e-117b-4751-b30d-e1f61a1adcc3 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:52:42 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de87916e-117b-4751-b30d-e1f61a1adcc3 1073741824 Sep 16 17:52:42 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Flow 'volume_create_manager' (23366c82-c0b5-4152-a68b-818844bdbb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0230a985-c4d1-4ca6-8cb5-95dd2cb2ce08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0230a985-c4d1-4ca6-8cb5-95dd2cb2ce08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1042298432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ed33d3-19ff-49cc-a93d-65040ca87e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effd3b6310564353bbf45c2425d83ba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:52:43Z,use_quota=True,user_id='b08012c0ba024d3bb6cee4d830f9ff26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e791ab-d90a-4cf4-acea-de58c91656f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e791ab-d90a-4cf4-acea-de58c91656f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512b030b-db34-4555-8a4b-b3c1ddf05792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512b030b-db34-4555-8a4b-b3c1ddf05792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50ed33d3-19ff-49cc-a93d-65040ca87e5b', 'volume_name': 'volume-50ed33d3-19ff-49cc-a93d-65040ca87e5b', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f5f354-b4cd-4b89-9ddf-06d4b33325cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f5f354-b4cd-4b89-9ddf-06d4b33325cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae12f9f-1f1e-42fc-9333-c944baab93c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:52:42 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Volume 50ed33d3-19ff-49cc-a93d-65040ca87e5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50ed33d3-19ff-49cc-a93d-65040ca87e5b', 'volume_size': 1} Sep 16 17:52:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:52:43 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Sep 16 17:52:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de87916e-117b-4751-b30d-e1f61a1adcc3 1073741824" returned: 0 in 0.715s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:52:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de87916e-117b-4751-b30d-e1f61a1adcc3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:52:43 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de87916e-117b-4751-b30d-e1f61a1adcc3 Sep 16 17:52:43 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:52:43 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Sep 16 17:52:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de87916e-117b-4751-b30d-e1f61a1adcc3" returned: 0 in 0.302s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:52:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:52:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:52:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.554s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:52:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1042298432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ed33d3-19ff-49cc-a93d-65040ca87e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effd3b6310564353bbf45c2425d83ba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:52:43Z,use_quota=True,user_id='b08012c0ba024d3bb6cee4d830f9ff26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:52:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Creating volume 50ed33d3-19ff-49cc-a93d-65040ca87e5b {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:52:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:52:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:52:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:52:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:52:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:52:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:52:43 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:52:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-50ed33d3-19ff-49cc-a93d-65040ca87e5b 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:52:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844b2e77-8b34-4bb2-b759-0b39f5a5f82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de87916e-117b-4751-b30d-e1f61a1adcc3', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:52:43 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-50ed33d3-19ff-49cc-a93d-65040ca87e5b 1073741824 Sep 16 17:52:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a925e26-fc8c-484b-91f2-83695d1a88ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:52:43 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:52:43 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Volume volume-de87916e-117b-4751-b30d-e1f61a1adcc3 (de87916e-117b-4751-b30d-e1f61a1adcc3): created successfully Sep 16 17:52:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a925e26-fc8c-484b-91f2-83695d1a88ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:52:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Flow 'volume_create_manager' (3bfe5a94-86cb-4eb3-8984-5597f740326d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:52:43 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-a21bfa47-2a76-43ca-a272-04ac866f6332 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Created volume successfully. Sep 16 17:52:44 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Sep 16 17:52:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-50ed33d3-19ff-49cc-a93d-65040ca87e5b 1073741824" returned: 0 in 0.585s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:52:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-50ed33d3-19ff-49cc-a93d-65040ca87e5b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:52:44 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-50ed33d3-19ff-49cc-a93d-65040ca87e5b Sep 16 17:52:44 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:52:44 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Sep 16 17:52:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-50ed33d3-19ff-49cc-a93d-65040ca87e5b" returned: 0 in 0.282s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:52:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:52:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:52:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae12f9f-1f1e-42fc-9333-c944baab93c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50ed33d3-19ff-49cc-a93d-65040ca87e5b', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:52:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce7724c-f963-4059-8413-5234ba32889f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:52:44 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Volume volume-50ed33d3-19ff-49cc-a93d-65040ca87e5b (50ed33d3-19ff-49cc-a93d-65040ca87e5b): created successfully Sep 16 17:52:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce7724c-f963-4059-8413-5234ba32889f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:52:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Flow 'volume_create_manager' (23366c82-c0b5-4152-a68b-818844bdbb65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:52:44 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-242b6c4d-ae9a-45f6-b60a-98256de8fc00 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Created volume successfully. Sep 16 17:52:54 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:52:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Flow 'volume_create_manager' (e75c8688-fdd6-4947-8943-f431372ef889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:52:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04027abf-2df3-4cd1-9c3b-ae74906fb3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:52:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04027abf-2df3-4cd1-9c3b-ae74906fb3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1904732650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3bfcaaf-e842-4875-928c-5d1d79921957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c607053a9b42af915f16acf98edbfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:52:54Z,use_quota=True,user_id='dd27bc5bbb44488c9924319cc698bc56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:52:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb2e9da-8038-4e8c-bc22-530525db5910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:52:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb2e9da-8038-4e8c-bc22-530525db5910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:52:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743e723c-ceaa-4ac9-90a8-bde75970a993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:52:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743e723c-ceaa-4ac9-90a8-bde75970a993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3bfcaaf-e842-4875-928c-5d1d79921957', 'volume_name': 'volume-a3bfcaaf-e842-4875-928c-5d1d79921957', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:52:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70147266-7221-40e9-823e-df123a7b6b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:52:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70147266-7221-40e9-823e-df123a7b6b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:52:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb299166-15a5-49b7-9f8e-9affe1d169a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:52:54 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Volume a3bfcaaf-e842-4875-928c-5d1d79921957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3bfcaaf-e842-4875-928c-5d1d79921957', 'volume_size': 1} Sep 16 17:52:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:52:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:52:54 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1904732650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3bfcaaf-e842-4875-928c-5d1d79921957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c607053a9b42af915f16acf98edbfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:52:54Z,use_quota=True,user_id='dd27bc5bbb44488c9924319cc698bc56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:52:54 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Creating volume a3bfcaaf-e842-4875-928c-5d1d79921957 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:52:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:52:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:52:54 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:52:54 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:52:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:52:54 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:52:54 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:52:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:52:54 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957 1073741824 Sep 16 17:52:54 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:52:55 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Sep 16 17:52:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957 1073741824" returned: 0 in 0.643s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:52:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:52:55 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957 Sep 16 17:52:55 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:52:55 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Sep 16 17:52:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957" returned: 0 in 0.362s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:52:55 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:52:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:52:55 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb299166-15a5-49b7-9f8e-9affe1d169a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3bfcaaf-e842-4875-928c-5d1d79921957', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:52:55 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd56dfa0-a333-4f65-9da8-026adfc99d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:52:55 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Volume volume-a3bfcaaf-e842-4875-928c-5d1d79921957 (a3bfcaaf-e842-4875-928c-5d1d79921957): created successfully Sep 16 17:52:55 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd56dfa0-a333-4f65-9da8-026adfc99d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:52:55 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Flow 'volume_create_manager' (e75c8688-fdd6-4947-8943-f431372ef889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:52:55 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-2a39a940-50e8-47ab-98c7-374b674a9bcc tempest-TestStampPattern-1476496418 None] Created volume successfully. Sep 16 17:53:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:53:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:53:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:53:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:53:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:53:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:53:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:02 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:53:02 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:02 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.322s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:53:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager._thread_info {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:53:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread count: 28 {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:53:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread info: [<_MainThread(MainThread, started 123748124422272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:53:05 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=6,cinder:UPDATE=12,cinder:INSERT=1,cinder:DELETE=2 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:53:05 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:UPDATE=6,cinder:SELECT=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:53:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-8f569363-0dd8-4c76-abc5-1ff1e393ae73 req-5c151297-8d3e-416b-a349-27371943d930 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:53:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-8f569363-0dd8-4c76-abc5-1ff1e393ae73 req-5c151297-8d3e-416b-a349-27371943d930 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:53:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-8f569363-0dd8-4c76-abc5-1ff1e393ae73 req-5c151297-8d3e-416b-a349-27371943d930 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:53:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-8f569363-0dd8-4c76-abc5-1ff1e393ae73 req-5c151297-8d3e-416b-a349-27371943d930 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7', 'name': 'volume-de87916e-117b-4751-b30d-e1f61a1adcc3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3773f424-430e-4e61-a522-c9d3bd2ce989', 'enforce_multipath': True} {{(pid=85899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4920}} Sep 16 17:53:15 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-8f569363-0dd8-4c76-abc5-1ff1e393ae73 req-5c151297-8d3e-416b-a349-27371943d930 tempest-TestServerVolumeAttachmentScenario-1525665574 None] attachment_update completed successfully. Sep 16 17:53:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-4e25e614-e649-4e89-94ff-c46809623be5 req-ee198d75-ba99-493e-bf1c-96a1afa3086b tempest-TestServerVolumeAttachmentScenario-1525665574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:53:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-4e25e614-e649-4e89-94ff-c46809623be5 req-ee198d75-ba99-493e-bf1c-96a1afa3086b tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:53:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-4e25e614-e649-4e89-94ff-c46809623be5 req-ee198d75-ba99-493e-bf1c-96a1afa3086b tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:53:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-4e25e614-e649-4e89-94ff-c46809623be5 req-ee198d75-ba99-493e-bf1c-96a1afa3086b tempest-TestServerVolumeAttachmentScenario-1525665574 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7', 'name': 'volume-50ed33d3-19ff-49cc-a93d-65040ca87e5b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eada2c00-21ac-48eb-b236-c66e37c01a91', 'enforce_multipath': True} {{(pid=85899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4920}} Sep 16 17:53:19 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-4e25e614-e649-4e89-94ff-c46809623be5 req-ee198d75-ba99-493e-bf1c-96a1afa3086b tempest-TestServerVolumeAttachmentScenario-1525665574 None] attachment_update completed successfully. Sep 16 17:53:21 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-979f9d99-ec6c-4cd7-9c57-3e95b78ba233 req-985e61f5-968d-433a-a6bb-e38a6f50a5ba tempest-TestServerVolumeAttachmentScenario-1525665574 None] Terminate volume connection completed successfully. Sep 16 17:53:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-979f9d99-ec6c-4cd7-9c57-3e95b78ba233 req-985e61f5-968d-433a-a6bb-e38a6f50a5ba tempest-TestServerVolumeAttachmentScenario-1525665574 None] Deleting attachment eada2c00-21ac-48eb-b236-c66e37c01a91. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:53:22 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-b0c3a37a-8a13-4e0f-bb4e-f5cb225a2205 req-7f0cd8b1-888b-4a8c-99fd-f6cc23941d31 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Terminate volume connection completed successfully. Sep 16 17:53:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-b0c3a37a-8a13-4e0f-bb4e-f5cb225a2205 req-7f0cd8b1-888b-4a8c-99fd-f6cc23941d31 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Deleting attachment 3773f424-430e-4e61-a522-c9d3bd2ce989. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:53:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-5085d6e7-97c7-4852-b52a-be98f83c6d8c req-fd10175d-22cf-4f78-9139-f4df98833c48 tempest-TestStampPattern-1476496418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:53:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-5085d6e7-97c7-4852-b52a-be98f83c6d8c req-fd10175d-22cf-4f78-9139-f4df98833c48 tempest-TestStampPattern-1476496418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:53:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-5085d6e7-97c7-4852-b52a-be98f83c6d8c req-fd10175d-22cf-4f78-9139-f4df98833c48 tempest-TestStampPattern-1476496418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:53:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-5085d6e7-97c7-4852-b52a-be98f83c6d8c req-fd10175d-22cf-4f78-9139-f4df98833c48 tempest-TestStampPattern-1476496418 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7', 'name': 'volume-a3bfcaaf-e842-4875-928c-5d1d79921957', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf5a424c-01b5-4d30-9272-77d19ad476d3', 'enforce_multipath': True} {{(pid=85899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4920}} Sep 16 17:53:26 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-5085d6e7-97c7-4852-b52a-be98f83c6d8c req-fd10175d-22cf-4f78-9139-f4df98833c48 tempest-TestStampPattern-1476496418 None] attachment_update completed successfully. Sep 16 17:53:27 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7bd5549a-d870-44a2-9698-1a395bd28677 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Acquiring lock "cinder-50ed33d3-19ff-49cc-a93d-65040ca87e5b-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:53:27 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7bd5549a-d870-44a2-9698-1a395bd28677 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "cinder-50ed33d3-19ff-49cc-a93d-65040ca87e5b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:53:27 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7bd5549a-d870-44a2-9698-1a395bd28677 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Acquiring lock "cinder-quobyte-50ed33d3-19ff-49cc-a93d-65040ca87e5b" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:53:27 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7bd5549a-d870-44a2-9698-1a395bd28677 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "cinder-quobyte-50ed33d3-19ff-49cc-a93d-65040ca87e5b" acquired by "delete_volume" :: waited 0.015s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:53:27 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffc80b6-9b9b-40dd-8318-efec5203970b]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:53:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7bd5549a-d870-44a2-9698-1a395bd28677 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-50ed33d3-19ff-49cc-a93d-65040ca87e5b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:27 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-50ed33d3-19ff-49cc-a93d-65040ca87e5b Sep 16 17:53:27 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:28 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7bd5549a-d870-44a2-9698-1a395bd28677 tempest-TestServerVolumeAttachmentScenario-1525665574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-50ed33d3-19ff-49cc-a93d-65040ca87e5b" returned: 0 in 0.365s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7bd5549a-d870-44a2-9698-1a395bd28677 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-50ed33d3-19ff-49cc-a93d-65040ca87e5b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:28 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-50ed33d3-19ff-49cc-a93d-65040ca87e5b Sep 16 17:53:28 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:28 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7bd5549a-d870-44a2-9698-1a395bd28677 tempest-TestServerVolumeAttachmentScenario-1525665574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-50ed33d3-19ff-49cc-a93d-65040ca87e5b" returned: 0 in 0.254s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7bd5549a-d870-44a2-9698-1a395bd28677 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "cinder-quobyte-50ed33d3-19ff-49cc-a93d-65040ca87e5b" released by "delete_volume" :: held 0.666s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:53:28 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-7bd5549a-d870-44a2-9698-1a395bd28677 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Created reservations ['60459913-9c66-41a2-aba4-08458ef2e167', 'd13cd3ea-2fea-48a5-ba4a-d1a546e1aac2', 'ef759ca6-adfd-4225-a607-7d2183d75970', 'ff498c41-ad41-4147-b798-92484c285488'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:53:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7bd5549a-d870-44a2-9698-1a395bd28677 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:53:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7bd5549a-d870-44a2-9698-1a395bd28677 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:53:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7bd5549a-d870-44a2-9698-1a395bd28677 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:53:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7bd5549a-d870-44a2-9698-1a395bd28677 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:53:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7bd5549a-d870-44a2-9698-1a395bd28677 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:53:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7bd5549a-d870-44a2-9698-1a395bd28677 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:28 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:53:28 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:28 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7bd5549a-d870-44a2-9698-1a395bd28677 tempest-TestServerVolumeAttachmentScenario-1525665574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.265s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:28 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-7bd5549a-d870-44a2-9698-1a395bd28677 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:53:28 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-7bd5549a-d870-44a2-9698-1a395bd28677 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Deleted volume successfully. Sep 16 17:53:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7bd5549a-d870-44a2-9698-1a395bd28677 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "cinder-50ed33d3-19ff-49cc-a93d-65040ca87e5b-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:53:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-96e091ff-d5f8-4dc6-90e0-24d667ddc498 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Acquiring lock "cinder-de87916e-117b-4751-b30d-e1f61a1adcc3-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:53:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-96e091ff-d5f8-4dc6-90e0-24d667ddc498 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "cinder-de87916e-117b-4751-b30d-e1f61a1adcc3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:53:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-96e091ff-d5f8-4dc6-90e0-24d667ddc498 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Acquiring lock "cinder-quobyte-de87916e-117b-4751-b30d-e1f61a1adcc3" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:53:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-96e091ff-d5f8-4dc6-90e0-24d667ddc498 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "cinder-quobyte-de87916e-117b-4751-b30d-e1f61a1adcc3" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:53:28 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3150dd63-44eb-45f5-982b-f7f8bb6cb56e]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:53:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-96e091ff-d5f8-4dc6-90e0-24d667ddc498 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de87916e-117b-4751-b30d-e1f61a1adcc3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:28 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de87916e-117b-4751-b30d-e1f61a1adcc3 Sep 16 17:53:28 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:29 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-96e091ff-d5f8-4dc6-90e0-24d667ddc498 tempest-TestServerVolumeAttachmentScenario-1525665574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de87916e-117b-4751-b30d-e1f61a1adcc3" returned: 0 in 0.374s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-96e091ff-d5f8-4dc6-90e0-24d667ddc498 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de87916e-117b-4751-b30d-e1f61a1adcc3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:29 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de87916e-117b-4751-b30d-e1f61a1adcc3 Sep 16 17:53:29 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:29 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-96e091ff-d5f8-4dc6-90e0-24d667ddc498 tempest-TestServerVolumeAttachmentScenario-1525665574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de87916e-117b-4751-b30d-e1f61a1adcc3" returned: 0 in 0.246s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:29 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-96e091ff-d5f8-4dc6-90e0-24d667ddc498 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "cinder-quobyte-de87916e-117b-4751-b30d-e1f61a1adcc3" released by "delete_volume" :: held 0.666s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:53:29 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-96e091ff-d5f8-4dc6-90e0-24d667ddc498 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Created reservations ['bb722f01-b2b8-4338-9dac-319b009f9a37', '2c6deb27-4f1f-40fd-a3d1-ed1634bfc5b2', '4fd1f157-079b-4ed1-bdbf-c2a5aaf4e8ec', 'c21653eb-cac5-434c-ba7c-02f3629670a7'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:53:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-96e091ff-d5f8-4dc6-90e0-24d667ddc498 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:53:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-96e091ff-d5f8-4dc6-90e0-24d667ddc498 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:53:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-96e091ff-d5f8-4dc6-90e0-24d667ddc498 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:53:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-96e091ff-d5f8-4dc6-90e0-24d667ddc498 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:53:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-96e091ff-d5f8-4dc6-90e0-24d667ddc498 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:53:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-96e091ff-d5f8-4dc6-90e0-24d667ddc498 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:29 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:53:29 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:29 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-96e091ff-d5f8-4dc6-90e0-24d667ddc498 tempest-TestServerVolumeAttachmentScenario-1525665574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.262s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:29 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-96e091ff-d5f8-4dc6-90e0-24d667ddc498 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:53:29 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-96e091ff-d5f8-4dc6-90e0-24d667ddc498 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Deleted volume successfully. Sep 16 17:53:29 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-96e091ff-d5f8-4dc6-90e0-24d667ddc498 tempest-TestServerVolumeAttachmentScenario-1525665574 None] Lock "cinder-de87916e-117b-4751-b30d-e1f61a1adcc3-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:53:31 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-683731ff-ccfd-408d-9056-76ee49d81763 req-4a0352ed-ba5a-4f8a-bb69-42b097d0405c tempest-TestStampPattern-1476496418 None] Terminate volume connection completed successfully. Sep 16 17:53:31 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-683731ff-ccfd-408d-9056-76ee49d81763 req-4a0352ed-ba5a-4f8a-bb69-42b097d0405c tempest-TestStampPattern-1476496418 None] Deleting attachment cf5a424c-01b5-4d30-9272-77d19ad476d3. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:53:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-50d3b375-fcbc-4ce8-873a-fc9669f7332e tempest-TestStampPattern-1476496418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:53:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-50d3b375-fcbc-4ce8-873a-fc9669f7332e tempest-TestStampPattern-1476496418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:53:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-50d3b375-fcbc-4ce8-873a-fc9669f7332e tempest-TestStampPattern-1476496418 None] Creating offline snapshot 60df5a05-60aa-4549-af28-ebae7a6db9a2 of volume a3bfcaaf-e842-4875-928c-5d1d79921957 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:53:32 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9425f751-800c-47e7-ba0e-1204618f4f96]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:53:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-50d3b375-fcbc-4ce8-873a-fc9669f7332e tempest-TestStampPattern-1476496418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:32 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957 Sep 16 17:53:32 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:33 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-50d3b375-fcbc-4ce8-873a-fc9669f7332e tempest-TestStampPattern-1476496418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957" returned: 0 in 0.358s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-50d3b375-fcbc-4ce8-873a-fc9669f7332e tempest-TestStampPattern-1476496418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.60df5a05-60aa-4549-af28-ebae7a6db9a2 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:33 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.60df5a05-60aa-4549-af28-ebae7a6db9a2 1G Sep 16 17:53:33 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:33 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-50d3b375-fcbc-4ce8-873a-fc9669f7332e tempest-TestStampPattern-1476496418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.60df5a05-60aa-4549-af28-ebae7a6db9a2 1G" returned: 0 in 0.451s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-50d3b375-fcbc-4ce8-873a-fc9669f7332e tempest-TestStampPattern-1476496418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3bfcaaf-e842-4875-928c-5d1d79921957 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.60df5a05-60aa-4549-af28-ebae7a6db9a2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:33 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3bfcaaf-e842-4875-928c-5d1d79921957 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.60df5a05-60aa-4549-af28-ebae7a6db9a2 Sep 16 17:53:33 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:33 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-50d3b375-fcbc-4ce8-873a-fc9669f7332e tempest-TestStampPattern-1476496418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3bfcaaf-e842-4875-928c-5d1d79921957 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.60df5a05-60aa-4549-af28-ebae7a6db9a2" returned: 0 in 0.341s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:33 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-50d3b375-fcbc-4ce8-873a-fc9669f7332e tempest-TestStampPattern-1476496418 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.60df5a05-60aa-4549-af28-ebae7a6db9a2 is being set with open permissions: ugo+rw Sep 16 17:53:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-50d3b375-fcbc-4ce8-873a-fc9669f7332e tempest-TestStampPattern-1476496418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.60df5a05-60aa-4549-af28-ebae7a6db9a2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:34 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.60df5a05-60aa-4549-af28-ebae7a6db9a2 Sep 16 17:53:34 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:34 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-50d3b375-fcbc-4ce8-873a-fc9669f7332e tempest-TestStampPattern-1476496418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.60df5a05-60aa-4549-af28-ebae7a6db9a2" returned: 0 in 0.278s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-50d3b375-fcbc-4ce8-873a-fc9669f7332e tempest-TestStampPattern-1476496418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:34 devstack sudo[102854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.info Sep 16 17:53:34 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:34 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-50d3b375-fcbc-4ce8-873a-fc9669f7332e tempest-TestStampPattern-1476496418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.info" returned: 0 in 0.267s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:34 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-50d3b375-fcbc-4ce8-873a-fc9669f7332e tempest-TestStampPattern-1476496418 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.info is being set with open permissions: ugo+rw Sep 16 17:53:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-50d3b375-fcbc-4ce8-873a-fc9669f7332e tempest-TestStampPattern-1476496418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:34 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.info Sep 16 17:53:34 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:34 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-50d3b375-fcbc-4ce8-873a-fc9669f7332e tempest-TestStampPattern-1476496418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.info" returned: 0 in 0.251s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-50d3b375-fcbc-4ce8-873a-fc9669f7332e tempest-TestStampPattern-1476496418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.057s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:53:34 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-50d3b375-fcbc-4ce8-873a-fc9669f7332e tempest-TestStampPattern-1476496418 None] Create snapshot completed successfully Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Flow 'volume_create_manager' (94b735f3-9682-4927-979e-872420b3ef81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1924a0-0528-459a-912f-86ed44937e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1924a0-0528-459a-912f-86ed44937e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-872000017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7a7bc5-8c25-491c-bf83-7dc6b86589e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='693026af67c1478694c3f039f0623a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:53:42Z,use_quota=True,user_id='0036376959494aafa8a7b7655ef8faeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3282f4-f13f-421f-b303-b5e6e85a3a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3282f4-f13f-421f-b303-b5e6e85a3a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a181bbb9-aedc-4084-812d-f0bfa2e7012d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a181bbb9-aedc-4084-812d-f0bfa2e7012d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae7a7bc5-8c25-491c-bf83-7dc6b86589e0', 'volume_name': 'volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb83817c-e132-4924-abe1-efb04764596e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb83817c-e132-4924-abe1-efb04764596e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f7ae57-6187-454b-ac99-2766ca57d4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:53:42 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Volume ae7a7bc5-8c25-491c-bf83-7dc6b86589e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0', 'volume_size': 1} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-872000017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7a7bc5-8c25-491c-bf83-7dc6b86589e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='693026af67c1478694c3f039f0623a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:53:42Z,use_quota=True,user_id='0036376959494aafa8a7b7655ef8faeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Creating volume ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:53:42 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:42 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 1073741824 Sep 16 17:53:42 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:42 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 1073741824" returned: 0 in 0.580s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:42 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 Sep 16 17:53:42 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Flow 'volume_create_manager' (186e3621-a066-410b-afe3-6d19fde0a6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f4da00-3dca-430d-97b7-e80ec387ee10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f4da00-3dca-430d-97b7-e80ec387ee10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-825689334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=938de10c-ae07-44a6-a7a9-7e06263e3289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c607053a9b42af915f16acf98edbfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=60df5a05-60aa-4549-af28-ebae7a6db9a2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:53:43Z,use_quota=True,user_id='dd27bc5bbb44488c9924319cc698bc56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cfaaf1c-d5f0-443f-a00d-c016b87262a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:53:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cfaaf1c-d5f0-443f-a00d-c016b87262a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7bb20f-8b42-45d7-9cfc-8873bd5df36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7bb20f-8b42-45d7-9cfc-8873bd5df36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '938de10c-ae07-44a6-a7a9-7e06263e3289', 'volume_name': 'volume-938de10c-ae07-44a6-a7a9-7e06263e3289', 'volume_size': 1, 'snapshot_id': '60df5a05-60aa-4549-af28-ebae7a6db9a2'}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97a6345-e482-464f-a460-0fe1e64aa81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97a6345-e482-464f-a460-0fe1e64aa81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ca15b3-697b-4a8c-8b1f-b284ef5b09ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:53:43 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Volume 938de10c-ae07-44a6-a7a9-7e06263e3289: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-938de10c-ae07-44a6-a7a9-7e06263e3289', 'volume_size': 1, 'snapshot_id': '60df5a05-60aa-4549-af28-ebae7a6db9a2'} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:53:43 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0" returned: 0 in 0.287s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.173s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Acquiring lock "cinder-quobyte-60df5a05-60aa-4549-af28-ebae7a6db9a2-938de10c-ae07-44a6-a7a9-7e06263e3289" by "_create_volume_from_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f7ae57-6187-454b-ac99-2766ca57d4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2388ecb9-e8c0-404e-95bf-f7ff3c21bb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Lock "cinder-quobyte-60df5a05-60aa-4549-af28-ebae7a6db9a2-938de10c-ae07-44a6-a7a9-7e06263e3289" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Creating volume 938de10c-ae07-44a6-a7a9-7e06263e3289 from snapshot 60df5a05-60aa-4549-af28-ebae7a6db9a2 {{(pid=85899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Acquiring lock "cinder-quobyte-938de10c-ae07-44a6-a7a9-7e06263e3289" by "_copy_volume_from_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:53:43 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Volume volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 (ae7a7bc5-8c25-491c-bf83-7dc6b86589e0): created successfully Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2388ecb9-e8c0-404e-95bf-f7ff3c21bb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Flow 'volume_create_manager' (94b735f3-9682-4927-979e-872420b3ef81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Lock "cinder-quobyte-938de10c-ae07-44a6-a7a9-7e06263e3289" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] snapshot: 60df5a05-60aa-4549-af28-ebae7a6db9a2, volume: 938de10c-ae07-44a6-a7a9-7e06263e3289, {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 17:53:43 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-68839488-32f8-477b-8a20-14a5b108d195 tempest-VolumeDependencyTests-1490035589 None] Created volume successfully. Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a369a643-0f78-45b0-bc8c-cfc6dd679e16]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.60df5a05-60aa-4549-af28-ebae7a6db9a2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:43 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.60df5a05-60aa-4549-af28-ebae7a6db9a2 Sep 16 17:53:43 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:43 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.60df5a05-60aa-4549-af28-ebae7a6db9a2" returned: 0 in 0.411s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3bfcaaf-e842-4875-928c-5d1d79921957(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f6953b-bf7d-42bc-a045-16701220cdf8]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:53:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:43 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957 Sep 16 17:53:43 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:44 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957" returned: 0 in 0.401s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957 {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 17:53:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Creating direct copy from snapshot {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 17:53:44 devstack cinder-volume[85899]: DEBUG cinder.utils [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Path /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-938de10c-ae07-44a6-a7a9-7e06263e3289 not found in is_blk_device check {{(pid=85899) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 17:53:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-938de10c-ae07-44a6-a7a9-7e06263e3289 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:44 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-938de10c-ae07-44a6-a7a9-7e06263e3289 Sep 16 17:53:44 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-20cbcb8f-ca9a-4d05-90a9-f7f0e5af2a13 tempest-VolumeDependencyTests-1490035589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:53:52 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-938de10c-ae07-44a6-a7a9-7e06263e3289" returned: 0 in 8.627s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:52 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Image conversion details: src /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957, size 1024.00 MB, duration 8.63 sec, destination /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-938de10c-ae07-44a6-a7a9-7e06263e3289 {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:53:52 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Converted 1024.00 MB image at 118.69 MB/s Sep 16 17:53:52 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-938de10c-ae07-44a6-a7a9-7e06263e3289 is being set with open permissions: ugo+rw Sep 16 17:53:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-938de10c-ae07-44a6-a7a9-7e06263e3289 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:52 devstack sudo[103035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-938de10c-ae07-44a6-a7a9-7e06263e3289 Sep 16 17:53:52 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:53 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-938de10c-ae07-44a6-a7a9-7e06263e3289" returned: 0 in 0.347s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:53 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Lock "cinder-quobyte-938de10c-ae07-44a6-a7a9-7e06263e3289" released by "_copy_volume_from_snapshot" :: held 9.906s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:53:53 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Lock "cinder-quobyte-60df5a05-60aa-4549-af28-ebae7a6db9a2-938de10c-ae07-44a6-a7a9-7e06263e3289" released by "_create_volume_from_snapshot" :: held 9.999s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:53:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.037s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:53:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-20cbcb8f-ca9a-4d05-90a9-f7f0e5af2a13 tempest-VolumeDependencyTests-1490035589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.761s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:53:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-20cbcb8f-ca9a-4d05-90a9-f7f0e5af2a13 tempest-VolumeDependencyTests-1490035589 None] Creating offline snapshot 3db7d86a-57e5-4aa5-9abf-2297281df951 of volume ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:53:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ca15b3-697b-4a8c-8b1f-b284ef5b09ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-938de10c-ae07-44a6-a7a9-7e06263e3289', 'volume_size': 1, 'snapshot_id': '60df5a05-60aa-4549-af28-ebae7a6db9a2'}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:53:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d54ae1c-b34e-45cd-9be9-c1fe4424788a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:53:53 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d330d013-e219-49cd-be01-34f2164a6726]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:53:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20cbcb8f-ca9a-4d05-90a9-f7f0e5af2a13 tempest-VolumeDependencyTests-1490035589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:53 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Volume volume-938de10c-ae07-44a6-a7a9-7e06263e3289 (938de10c-ae07-44a6-a7a9-7e06263e3289): created successfully Sep 16 17:53:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d54ae1c-b34e-45cd-9be9-c1fe4424788a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:53:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Flow 'volume_create_manager' (186e3621-a066-410b-afe3-6d19fde0a6ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:53:53 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-6554ad61-0ad5-49a8-9892-b1f7f21a7a4f tempest-TestStampPattern-1476496418 None] Created volume successfully. Sep 16 17:53:53 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 Sep 16 17:53:53 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:53 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20cbcb8f-ca9a-4d05-90a9-f7f0e5af2a13 tempest-VolumeDependencyTests-1490035589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0" returned: 0 in 0.397s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20cbcb8f-ca9a-4d05-90a9-f7f0e5af2a13 tempest-VolumeDependencyTests-1490035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.3db7d86a-57e5-4aa5-9abf-2297281df951 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:53 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.3db7d86a-57e5-4aa5-9abf-2297281df951 1G Sep 16 17:53:53 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:54 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20cbcb8f-ca9a-4d05-90a9-f7f0e5af2a13 tempest-VolumeDependencyTests-1490035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.3db7d86a-57e5-4aa5-9abf-2297281df951 1G" returned: 0 in 0.420s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20cbcb8f-ca9a-4d05-90a9-f7f0e5af2a13 tempest-VolumeDependencyTests-1490035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.3db7d86a-57e5-4aa5-9abf-2297281df951 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:54 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.3db7d86a-57e5-4aa5-9abf-2297281df951 Sep 16 17:53:54 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:54 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20cbcb8f-ca9a-4d05-90a9-f7f0e5af2a13 tempest-VolumeDependencyTests-1490035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.3db7d86a-57e5-4aa5-9abf-2297281df951" returned: 0 in 0.358s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:54 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-20cbcb8f-ca9a-4d05-90a9-f7f0e5af2a13 tempest-VolumeDependencyTests-1490035589 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.3db7d86a-57e5-4aa5-9abf-2297281df951 is being set with open permissions: ugo+rw Sep 16 17:53:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20cbcb8f-ca9a-4d05-90a9-f7f0e5af2a13 tempest-VolumeDependencyTests-1490035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.3db7d86a-57e5-4aa5-9abf-2297281df951 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:54 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.3db7d86a-57e5-4aa5-9abf-2297281df951 Sep 16 17:53:54 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:54 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20cbcb8f-ca9a-4d05-90a9-f7f0e5af2a13 tempest-VolumeDependencyTests-1490035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.3db7d86a-57e5-4aa5-9abf-2297281df951" returned: 0 in 0.296s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20cbcb8f-ca9a-4d05-90a9-f7f0e5af2a13 tempest-VolumeDependencyTests-1490035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:54 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.info Sep 16 17:53:54 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:55 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20cbcb8f-ca9a-4d05-90a9-f7f0e5af2a13 tempest-VolumeDependencyTests-1490035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.info" returned: 0 in 0.275s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:55 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-20cbcb8f-ca9a-4d05-90a9-f7f0e5af2a13 tempest-VolumeDependencyTests-1490035589 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.info is being set with open permissions: ugo+rw Sep 16 17:53:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20cbcb8f-ca9a-4d05-90a9-f7f0e5af2a13 tempest-VolumeDependencyTests-1490035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:55 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.info Sep 16 17:53:55 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:55 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20cbcb8f-ca9a-4d05-90a9-f7f0e5af2a13 tempest-VolumeDependencyTests-1490035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.info" returned: 0 in 0.305s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-20cbcb8f-ca9a-4d05-90a9-f7f0e5af2a13 tempest-VolumeDependencyTests-1490035589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.181s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:53:55 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-20cbcb8f-ca9a-4d05-90a9-f7f0e5af2a13 tempest-VolumeDependencyTests-1490035589 None] Create snapshot completed successfully Sep 16 17:53:56 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:53:56 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Flow 'volume_create_manager' (9398c84e-5453-423a-9a6c-20b52b597e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:53:56 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d17b2976-b26c-442a-9f0f-7fbcddf92094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:53:56 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d17b2976-b26c-442a-9f0f-7fbcddf92094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1822708609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ce8ecf-3c87-4175-8210-023b80777373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='693026af67c1478694c3f039f0623a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3db7d86a-57e5-4aa5-9abf-2297281df951,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:53:57Z,use_quota=True,user_id='0036376959494aafa8a7b7655ef8faeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:53:56 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ecd6db-2bd0-46c8-8e2e-35bd690fb9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:53:56 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ecd6db-2bd0-46c8-8e2e-35bd690fb9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:53:56 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6baa00aa-9ef2-4767-8a7e-415eb3fe5549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:53:56 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6baa00aa-9ef2-4767-8a7e-415eb3fe5549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '96ce8ecf-3c87-4175-8210-023b80777373', 'volume_name': 'volume-96ce8ecf-3c87-4175-8210-023b80777373', 'volume_size': 1, 'snapshot_id': '3db7d86a-57e5-4aa5-9abf-2297281df951'}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:53:56 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01b262c-5502-4a60-b0e8-67eccd64939a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:53:56 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01b262c-5502-4a60-b0e8-67eccd64939a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:53:56 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87fa9178-7a51-414f-8eab-a2001b18f0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:53:56 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Volume 96ce8ecf-3c87-4175-8210-023b80777373: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-96ce8ecf-3c87-4175-8210-023b80777373', 'volume_size': 1, 'snapshot_id': '3db7d86a-57e5-4aa5-9abf-2297281df951'} Sep 16 17:53:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:53:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:53:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Acquiring lock "cinder-quobyte-3db7d86a-57e5-4aa5-9abf-2297281df951-96ce8ecf-3c87-4175-8210-023b80777373" by "_create_volume_from_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Lock "cinder-quobyte-3db7d86a-57e5-4aa5-9abf-2297281df951-96ce8ecf-3c87-4175-8210-023b80777373" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Creating volume 96ce8ecf-3c87-4175-8210-023b80777373 from snapshot 3db7d86a-57e5-4aa5-9abf-2297281df951 {{(pid=85899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Acquiring lock "cinder-quobyte-96ce8ecf-3c87-4175-8210-023b80777373" by "_copy_volume_from_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Lock "cinder-quobyte-96ce8ecf-3c87-4175-8210-023b80777373" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] snapshot: 3db7d86a-57e5-4aa5-9abf-2297281df951, volume: 96ce8ecf-3c87-4175-8210-023b80777373, {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee6a8df-072a-4663-a84d-7e87dadf8624]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.3db7d86a-57e5-4aa5-9abf-2297281df951 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:57 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.3db7d86a-57e5-4aa5-9abf-2297281df951 Sep 16 17:53:57 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:57 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.3db7d86a-57e5-4aa5-9abf-2297281df951" returned: 0 in 0.402s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60f466f-99d0-4638-948a-da0de926f499]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:57 devstack sudo[103070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 Sep 16 17:53:57 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:53:57 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0" returned: 0 in 0.362s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Creating direct copy from snapshot {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG cinder.utils [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Path /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-96ce8ecf-3c87-4175-8210-023b80777373 not found in is_blk_device check {{(pid=85899) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 17:53:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-96ce8ecf-3c87-4175-8210-023b80777373 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:53:57 devstack sudo[103075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-96ce8ecf-3c87-4175-8210-023b80777373 Sep 16 17:53:57 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:54:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:54:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:54:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:54:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:54:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:54:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:54:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:54:02 devstack sudo[103089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:54:02 devstack sudo[103089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:54:02 devstack sudo[103089]: pam_unix(sudo:session): session closed for user root Sep 16 17:54:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.433s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:54:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:54:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager._thread_info {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:54:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread count: 28 {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:54:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread info: [<_MainThread(MainThread, started 123748124422272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:54:04 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root Sep 16 17:54:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-96ce8ecf-3c87-4175-8210-023b80777373" returned: 0 in 6.136s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:54:04 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Image conversion details: src /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-96ce8ecf-3c87-4175-8210-023b80777373 {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:54:04 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Converted 1024.00 MB image at 166.85 MB/s Sep 16 17:54:04 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-96ce8ecf-3c87-4175-8210-023b80777373 is being set with open permissions: ugo+rw Sep 16 17:54:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-96ce8ecf-3c87-4175-8210-023b80777373 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:54:04 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-96ce8ecf-3c87-4175-8210-023b80777373 Sep 16 17:54:04 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:54:04 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Sep 16 17:54:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-96ce8ecf-3c87-4175-8210-023b80777373" returned: 0 in 0.231s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:54:04 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Lock "cinder-quobyte-96ce8ecf-3c87-4175-8210-023b80777373" released by "_copy_volume_from_snapshot" :: held 7.228s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:54:04 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Lock "cinder-quobyte-3db7d86a-57e5-4aa5-9abf-2297281df951-96ce8ecf-3c87-4175-8210-023b80777373" released by "_create_volume_from_snapshot" :: held 7.296s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:54:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.314s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:54:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87fa9178-7a51-414f-8eab-a2001b18f0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96ce8ecf-3c87-4175-8210-023b80777373', 'volume_size': 1, 'snapshot_id': '3db7d86a-57e5-4aa5-9abf-2297281df951'}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:54:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe05969d-1afb-4d11-bc61-6d15e82580a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:54:04 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Volume volume-96ce8ecf-3c87-4175-8210-023b80777373 (96ce8ecf-3c87-4175-8210-023b80777373): created successfully Sep 16 17:54:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe05969d-1afb-4d11-bc61-6d15e82580a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:54:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Flow 'volume_create_manager' (9398c84e-5453-423a-9a6c-20b52b597e1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:54:04 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-786328aa-483c-4fe8-a9e1-2326f708e426 tempest-VolumeDependencyTests-1490035589 None] Created volume successfully. Sep 16 17:54:05 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-89c5a115-3dd6-4e9a-8f89-bcd76bad984f tempest-VolumeDependencyTests-1490035589 None] Acquiring lock "cinder-3db7d86a-57e5-4aa5-9abf-2297281df951-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:54:05 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-89c5a115-3dd6-4e9a-8f89-bcd76bad984f tempest-VolumeDependencyTests-1490035589 None] Lock "cinder-3db7d86a-57e5-4aa5-9abf-2297281df951-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:54:05 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-89c5a115-3dd6-4e9a-8f89-bcd76bad984f tempest-VolumeDependencyTests-1490035589 None] Acquiring lock "cinder-quobyte-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:54:05 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-89c5a115-3dd6-4e9a-8f89-bcd76bad984f tempest-VolumeDependencyTests-1490035589 None] Lock "cinder-quobyte-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:54:05 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-89c5a115-3dd6-4e9a-8f89-bcd76bad984f tempest-VolumeDependencyTests-1490035589 None] Acquiring lock "cinder-quobyte-3db7d86a-57e5-4aa5-9abf-2297281df951" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:54:05 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-89c5a115-3dd6-4e9a-8f89-bcd76bad984f tempest-VolumeDependencyTests-1490035589 None] Lock "cinder-quobyte-3db7d86a-57e5-4aa5-9abf-2297281df951" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:54:05 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-89c5a115-3dd6-4e9a-8f89-bcd76bad984f tempest-VolumeDependencyTests-1490035589 None] Deleting offline snapshot 3db7d86a-57e5-4aa5-9abf-2297281df951 of volume ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:54:05 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-89c5a115-3dd6-4e9a-8f89-bcd76bad984f tempest-VolumeDependencyTests-1490035589 None] snapshot_file for this snap is: volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.3db7d86a-57e5-4aa5-9abf-2297281df951 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:54:05 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[82edb5e8-b767-449a-a756-b8d7dc498962]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:54:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-89c5a115-3dd6-4e9a-8f89-bcd76bad984f tempest-VolumeDependencyTests-1490035589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.3db7d86a-57e5-4aa5-9abf-2297281df951 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:54:05 devstack sudo[103096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.3db7d86a-57e5-4aa5-9abf-2297281df951 Sep 16 17:54:05 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:54:05 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root Sep 16 17:54:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-89c5a115-3dd6-4e9a-8f89-bcd76bad984f tempest-VolumeDependencyTests-1490035589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.3db7d86a-57e5-4aa5-9abf-2297281df951" returned: 0 in 0.373s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:54:05 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-89c5a115-3dd6-4e9a-8f89-bcd76bad984f tempest-VolumeDependencyTests-1490035589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:54:05 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2483b514-83d0-4c89-822a-fc34c70c2ebe]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:54:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-89c5a115-3dd6-4e9a-8f89-bcd76bad984f tempest-VolumeDependencyTests-1490035589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:54:06 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 Sep 16 17:54:06 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:54:06 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Sep 16 17:54:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-89c5a115-3dd6-4e9a-8f89-bcd76bad984f tempest-VolumeDependencyTests-1490035589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0" returned: 0 in 0.520s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:54:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-89c5a115-3dd6-4e9a-8f89-bcd76bad984f tempest-VolumeDependencyTests-1490035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.3db7d86a-57e5-4aa5-9abf-2297281df951 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:54:06 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.3db7d86a-57e5-4aa5-9abf-2297281df951 Sep 16 17:54:06 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:54:06 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Sep 16 17:54:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-89c5a115-3dd6-4e9a-8f89-bcd76bad984f tempest-VolumeDependencyTests-1490035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.3db7d86a-57e5-4aa5-9abf-2297281df951" returned: 0 in 0.367s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:54:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-89c5a115-3dd6-4e9a-8f89-bcd76bad984f tempest-VolumeDependencyTests-1490035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.3db7d86a-57e5-4aa5-9abf-2297281df951 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:54:06 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.3db7d86a-57e5-4aa5-9abf-2297281df951 Sep 16 17:54:06 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:54:07 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Sep 16 17:54:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-89c5a115-3dd6-4e9a-8f89-bcd76bad984f tempest-VolumeDependencyTests-1490035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0.3db7d86a-57e5-4aa5-9abf-2297281df951" returned: 0 in 0.239s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:54:07 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:UPDATE=31,cinder:SELECT=53,cinder:INSERT=4,cinder:DELETE=3 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:54:07 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=47,cinder:UPDATE=35,cinder:INSERT=9,cinder:DELETE=4 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:54:07 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-89c5a115-3dd6-4e9a-8f89-bcd76bad984f tempest-VolumeDependencyTests-1490035589 None] Lock "cinder-quobyte-3db7d86a-57e5-4aa5-9abf-2297281df951" released by "_delete_snapshot" :: held 1.605s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:54:07 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-89c5a115-3dd6-4e9a-8f89-bcd76bad984f tempest-VolumeDependencyTests-1490035589 None] Lock "cinder-quobyte-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0" released by "delete_snapshot" :: held 1.626s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:54:07 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-89c5a115-3dd6-4e9a-8f89-bcd76bad984f tempest-VolumeDependencyTests-1490035589 None] Created reservations ['bbb96871-86ba-4f3d-81ed-cfc1180be835', '7a85a93e-c907-4313-bbac-d7240dce2422', '484cc978-369d-47f2-8c9a-c8378ad96691', '18628e98-8911-4df7-b6ee-57ab7eee098f'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:54:07 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-89c5a115-3dd6-4e9a-8f89-bcd76bad984f tempest-VolumeDependencyTests-1490035589 None] Delete snapshot completed successfully. Sep 16 17:54:07 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-89c5a115-3dd6-4e9a-8f89-bcd76bad984f tempest-VolumeDependencyTests-1490035589 None] Lock "cinder-3db7d86a-57e5-4aa5-9abf-2297281df951-delete_snapshot" released by "delete_snapshot" :: held 1.755s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:54:07 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f29da893-dbb2-4d43-a937-99da02ed0405 tempest-VolumeDependencyTests-1490035589 None] Acquiring lock "cinder-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:54:07 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f29da893-dbb2-4d43-a937-99da02ed0405 tempest-VolumeDependencyTests-1490035589 None] Lock "cinder-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:54:07 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f29da893-dbb2-4d43-a937-99da02ed0405 tempest-VolumeDependencyTests-1490035589 None] Acquiring lock "cinder-quobyte-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:54:07 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f29da893-dbb2-4d43-a937-99da02ed0405 tempest-VolumeDependencyTests-1490035589 None] Lock "cinder-quobyte-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0" acquired by "delete_volume" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:54:07 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc2cf73-3ba5-46bc-b9c1-dc9daea9bbad]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:54:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f29da893-dbb2-4d43-a937-99da02ed0405 tempest-VolumeDependencyTests-1490035589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:54:07 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 Sep 16 17:54:07 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:54:08 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Sep 16 17:54:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f29da893-dbb2-4d43-a937-99da02ed0405 tempest-VolumeDependencyTests-1490035589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0" returned: 0 in 0.348s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:54:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f29da893-dbb2-4d43-a937-99da02ed0405 tempest-VolumeDependencyTests-1490035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:54:08 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0 Sep 16 17:54:08 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:54:08 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Sep 16 17:54:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f29da893-dbb2-4d43-a937-99da02ed0405 tempest-VolumeDependencyTests-1490035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0" returned: 0 in 0.246s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:54:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f29da893-dbb2-4d43-a937-99da02ed0405 tempest-VolumeDependencyTests-1490035589 None] Lock "cinder-quobyte-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0" released by "delete_volume" :: held 0.657s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:54:08 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-f29da893-dbb2-4d43-a937-99da02ed0405 tempest-VolumeDependencyTests-1490035589 None] Created reservations ['2597d1bb-2009-4213-adf3-bf9b5f1ddfb9', '6a6005b5-4b63-4bf9-8263-86d732d99e8a', '175afdf3-f974-4915-8313-25b1f5381df4', 'e5583cad-23dd-4763-89b0-f14c637149ad'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:54:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f29da893-dbb2-4d43-a937-99da02ed0405 tempest-VolumeDependencyTests-1490035589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:54:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f29da893-dbb2-4d43-a937-99da02ed0405 tempest-VolumeDependencyTests-1490035589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:54:08 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f29da893-dbb2-4d43-a937-99da02ed0405 tempest-VolumeDependencyTests-1490035589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:54:08 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f29da893-dbb2-4d43-a937-99da02ed0405 tempest-VolumeDependencyTests-1490035589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:54:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f29da893-dbb2-4d43-a937-99da02ed0405 tempest-VolumeDependencyTests-1490035589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:54:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f29da893-dbb2-4d43-a937-99da02ed0405 tempest-VolumeDependencyTests-1490035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:54:08 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:54:08 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:54:08 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Sep 16 17:54:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f29da893-dbb2-4d43-a937-99da02ed0405 tempest-VolumeDependencyTests-1490035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.234s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:54:08 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-f29da893-dbb2-4d43-a937-99da02ed0405 tempest-VolumeDependencyTests-1490035589 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:54:08 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-f29da893-dbb2-4d43-a937-99da02ed0405 tempest-VolumeDependencyTests-1490035589 None] Deleted volume successfully. Sep 16 17:54:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f29da893-dbb2-4d43-a937-99da02ed0405 tempest-VolumeDependencyTests-1490035589 None] Lock "cinder-ae7a7bc5-8c25-491c-bf83-7dc6b86589e0-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:54:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fc1924ce-d088-4c7a-93f9-29262dc988bc tempest-VolumeDependencyTests-1490035589 None] Acquiring lock "cinder-96ce8ecf-3c87-4175-8210-023b80777373-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:54:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fc1924ce-d088-4c7a-93f9-29262dc988bc tempest-VolumeDependencyTests-1490035589 None] Lock "cinder-96ce8ecf-3c87-4175-8210-023b80777373-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:54:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fc1924ce-d088-4c7a-93f9-29262dc988bc tempest-VolumeDependencyTests-1490035589 None] Acquiring lock "cinder-quobyte-96ce8ecf-3c87-4175-8210-023b80777373" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:54:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fc1924ce-d088-4c7a-93f9-29262dc988bc tempest-VolumeDependencyTests-1490035589 None] Lock "cinder-quobyte-96ce8ecf-3c87-4175-8210-023b80777373" acquired by "delete_volume" :: waited 0.014s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:54:08 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69a6d19-99c2-4661-867d-f93cef74edfe]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:54:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc1924ce-d088-4c7a-93f9-29262dc988bc tempest-VolumeDependencyTests-1490035589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-96ce8ecf-3c87-4175-8210-023b80777373 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:54:09 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-96ce8ecf-3c87-4175-8210-023b80777373 Sep 16 17:54:09 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:54:09 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Sep 16 17:54:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc1924ce-d088-4c7a-93f9-29262dc988bc tempest-VolumeDependencyTests-1490035589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-96ce8ecf-3c87-4175-8210-023b80777373" returned: 0 in 0.365s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:54:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc1924ce-d088-4c7a-93f9-29262dc988bc tempest-VolumeDependencyTests-1490035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-96ce8ecf-3c87-4175-8210-023b80777373 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:54:09 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-96ce8ecf-3c87-4175-8210-023b80777373 Sep 16 17:54:09 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:54:09 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Sep 16 17:54:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc1924ce-d088-4c7a-93f9-29262dc988bc tempest-VolumeDependencyTests-1490035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-96ce8ecf-3c87-4175-8210-023b80777373" returned: 0 in 0.245s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:54:09 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fc1924ce-d088-4c7a-93f9-29262dc988bc tempest-VolumeDependencyTests-1490035589 None] Lock "cinder-quobyte-96ce8ecf-3c87-4175-8210-023b80777373" released by "delete_volume" :: held 0.650s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:54:09 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-fc1924ce-d088-4c7a-93f9-29262dc988bc tempest-VolumeDependencyTests-1490035589 None] Created reservations ['92c82ab7-725d-457d-9ae4-9e93daaaafb5', '6bb9788b-3a5d-47d9-9f19-626a4eb73cb0', '1c7916c5-0fc8-4017-91b0-68485daf9737', '75c1828c-8d03-4c35-809b-096750abd24c'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:54:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fc1924ce-d088-4c7a-93f9-29262dc988bc tempest-VolumeDependencyTests-1490035589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:54:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fc1924ce-d088-4c7a-93f9-29262dc988bc tempest-VolumeDependencyTests-1490035589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:54:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fc1924ce-d088-4c7a-93f9-29262dc988bc tempest-VolumeDependencyTests-1490035589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:54:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fc1924ce-d088-4c7a-93f9-29262dc988bc tempest-VolumeDependencyTests-1490035589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:54:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fc1924ce-d088-4c7a-93f9-29262dc988bc tempest-VolumeDependencyTests-1490035589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:54:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc1924ce-d088-4c7a-93f9-29262dc988bc tempest-VolumeDependencyTests-1490035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:54:09 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:54:09 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:54:09 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Sep 16 17:54:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc1924ce-d088-4c7a-93f9-29262dc988bc tempest-VolumeDependencyTests-1490035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.231s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:54:09 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-fc1924ce-d088-4c7a-93f9-29262dc988bc tempest-VolumeDependencyTests-1490035589 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:54:09 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-fc1924ce-d088-4c7a-93f9-29262dc988bc tempest-VolumeDependencyTests-1490035589 None] Deleted volume successfully. Sep 16 17:54:09 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fc1924ce-d088-4c7a-93f9-29262dc988bc tempest-VolumeDependencyTests-1490035589 None] Lock "cinder-96ce8ecf-3c87-4175-8210-023b80777373-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:54:19 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=15,cinder:INSERT=6,cinder:UPDATE=23 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:54:19 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=14,cinder:INSERT=6,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:54:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-53d9827a-d28e-4e5a-8a76-19c83017563b req-13e623a7-d4c5-47d8-ad14-449b6b729feb tempest-TestStampPattern-1476496418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:54:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-53d9827a-d28e-4e5a-8a76-19c83017563b req-13e623a7-d4c5-47d8-ad14-449b6b729feb tempest-TestStampPattern-1476496418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:54:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [req-53d9827a-d28e-4e5a-8a76-19c83017563b req-13e623a7-d4c5-47d8-ad14-449b6b729feb tempest-TestStampPattern-1476496418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:54:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-53d9827a-d28e-4e5a-8a76-19c83017563b req-13e623a7-d4c5-47d8-ad14-449b6b729feb tempest-TestStampPattern-1476496418 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7', 'name': 'volume-938de10c-ae07-44a6-a7a9-7e06263e3289', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed198df7-aeb5-47e9-b154-9e77e024fc30', 'enforce_multipath': True} {{(pid=85899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4920}} Sep 16 17:54:34 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-53d9827a-d28e-4e5a-8a76-19c83017563b req-13e623a7-d4c5-47d8-ad14-449b6b729feb tempest-TestStampPattern-1476496418 None] attachment_update completed successfully. Sep 16 17:54:37 devstack cinder-volume[85899]: INFO cinder.volume.manager [req-979beea8-d50f-495e-a18e-8bafaef3d2ed req-43a46066-a355-4ccd-99eb-54388d5f76da tempest-TestStampPattern-1476496418 None] Terminate volume connection completed successfully. Sep 16 17:54:37 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [req-979beea8-d50f-495e-a18e-8bafaef3d2ed req-43a46066-a355-4ccd-99eb-54388d5f76da tempest-TestStampPattern-1476496418 None] Deleting attachment ed198df7-aeb5-47e9-b154-9e77e024fc30. {{(pid=85899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5051}} Sep 16 17:54:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-dc5477bd-b162-4e7a-a956-dcc51bb8d8af tempest-TestStampPattern-1476496418 None] Acquiring lock "cinder-938de10c-ae07-44a6-a7a9-7e06263e3289-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:54:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-dc5477bd-b162-4e7a-a956-dcc51bb8d8af tempest-TestStampPattern-1476496418 None] Lock "cinder-938de10c-ae07-44a6-a7a9-7e06263e3289-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:54:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-dc5477bd-b162-4e7a-a956-dcc51bb8d8af tempest-TestStampPattern-1476496418 None] Acquiring lock "cinder-quobyte-938de10c-ae07-44a6-a7a9-7e06263e3289" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:54:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-dc5477bd-b162-4e7a-a956-dcc51bb8d8af tempest-TestStampPattern-1476496418 None] Lock "cinder-quobyte-938de10c-ae07-44a6-a7a9-7e06263e3289" acquired by "delete_volume" :: waited 0.014s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:54:41 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd56f02d-5237-4e7f-97fd-56313f78d668]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:54:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dc5477bd-b162-4e7a-a956-dcc51bb8d8af tempest-TestStampPattern-1476496418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-938de10c-ae07-44a6-a7a9-7e06263e3289 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:54:41 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-938de10c-ae07-44a6-a7a9-7e06263e3289 Sep 16 17:54:41 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:54:41 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Sep 16 17:54:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dc5477bd-b162-4e7a-a956-dcc51bb8d8af tempest-TestStampPattern-1476496418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-938de10c-ae07-44a6-a7a9-7e06263e3289" returned: 0 in 0.373s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:54:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dc5477bd-b162-4e7a-a956-dcc51bb8d8af tempest-TestStampPattern-1476496418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-938de10c-ae07-44a6-a7a9-7e06263e3289 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:54:41 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-938de10c-ae07-44a6-a7a9-7e06263e3289 Sep 16 17:54:41 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:54:42 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Sep 16 17:54:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dc5477bd-b162-4e7a-a956-dcc51bb8d8af tempest-TestStampPattern-1476496418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-938de10c-ae07-44a6-a7a9-7e06263e3289" returned: 0 in 0.237s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:54:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-dc5477bd-b162-4e7a-a956-dcc51bb8d8af tempest-TestStampPattern-1476496418 None] Lock "cinder-quobyte-938de10c-ae07-44a6-a7a9-7e06263e3289" released by "delete_volume" :: held 0.652s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:54:42 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-dc5477bd-b162-4e7a-a956-dcc51bb8d8af tempest-TestStampPattern-1476496418 None] Created reservations ['eebe1d4f-c426-4448-ae59-8de4e86ce450', '112716bd-e0d0-443f-9eed-5ece50e1b5fa', '7f2599ed-66ea-460f-a347-d6964d8ba48a', '441019dd-abc3-433f-abf4-979aa5ccb252'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:54:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-dc5477bd-b162-4e7a-a956-dcc51bb8d8af tempest-TestStampPattern-1476496418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:54:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-dc5477bd-b162-4e7a-a956-dcc51bb8d8af tempest-TestStampPattern-1476496418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:54:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-dc5477bd-b162-4e7a-a956-dcc51bb8d8af tempest-TestStampPattern-1476496418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:54:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-dc5477bd-b162-4e7a-a956-dcc51bb8d8af tempest-TestStampPattern-1476496418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:54:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-dc5477bd-b162-4e7a-a956-dcc51bb8d8af tempest-TestStampPattern-1476496418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:54:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dc5477bd-b162-4e7a-a956-dcc51bb8d8af tempest-TestStampPattern-1476496418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:54:42 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:54:42 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:54:42 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Sep 16 17:54:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dc5477bd-b162-4e7a-a956-dcc51bb8d8af tempest-TestStampPattern-1476496418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.255s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:54:42 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-dc5477bd-b162-4e7a-a956-dcc51bb8d8af tempest-TestStampPattern-1476496418 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:54:42 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-dc5477bd-b162-4e7a-a956-dcc51bb8d8af tempest-TestStampPattern-1476496418 None] Deleted volume successfully. Sep 16 17:54:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-dc5477bd-b162-4e7a-a956-dcc51bb8d8af tempest-TestStampPattern-1476496418 None] Lock "cinder-938de10c-ae07-44a6-a7a9-7e06263e3289-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:54:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ef61925e-c799-4807-b516-826cf18bdc9c tempest-TestStampPattern-1476496418 None] Acquiring lock "cinder-60df5a05-60aa-4549-af28-ebae7a6db9a2-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:54:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ef61925e-c799-4807-b516-826cf18bdc9c tempest-TestStampPattern-1476496418 None] Lock "cinder-60df5a05-60aa-4549-af28-ebae7a6db9a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:54:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ef61925e-c799-4807-b516-826cf18bdc9c tempest-TestStampPattern-1476496418 None] Acquiring lock "cinder-quobyte-a3bfcaaf-e842-4875-928c-5d1d79921957" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:54:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ef61925e-c799-4807-b516-826cf18bdc9c tempest-TestStampPattern-1476496418 None] Lock "cinder-quobyte-a3bfcaaf-e842-4875-928c-5d1d79921957" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:54:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ef61925e-c799-4807-b516-826cf18bdc9c tempest-TestStampPattern-1476496418 None] Acquiring lock "cinder-quobyte-60df5a05-60aa-4549-af28-ebae7a6db9a2" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:54:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ef61925e-c799-4807-b516-826cf18bdc9c tempest-TestStampPattern-1476496418 None] Lock "cinder-quobyte-60df5a05-60aa-4549-af28-ebae7a6db9a2" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:54:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-ef61925e-c799-4807-b516-826cf18bdc9c tempest-TestStampPattern-1476496418 None] Deleting offline snapshot 60df5a05-60aa-4549-af28-ebae7a6db9a2 of volume a3bfcaaf-e842-4875-928c-5d1d79921957 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:54:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-ef61925e-c799-4807-b516-826cf18bdc9c tempest-TestStampPattern-1476496418 None] snapshot_file for this snap is: volume-a3bfcaaf-e842-4875-928c-5d1d79921957.60df5a05-60aa-4549-af28-ebae7a6db9a2 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:54:42 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3ea76c-f923-49f9-9820-4700722f708b]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:54:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ef61925e-c799-4807-b516-826cf18bdc9c tempest-TestStampPattern-1476496418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.60df5a05-60aa-4549-af28-ebae7a6db9a2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:54:43 devstack sudo[103675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.60df5a05-60aa-4549-af28-ebae7a6db9a2 Sep 16 17:54:43 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:54:43 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root Sep 16 17:54:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ef61925e-c799-4807-b516-826cf18bdc9c tempest-TestStampPattern-1476496418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.60df5a05-60aa-4549-af28-ebae7a6db9a2" returned: 0 in 0.365s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:54:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-ef61925e-c799-4807-b516-826cf18bdc9c tempest-TestStampPattern-1476496418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3bfcaaf-e842-4875-928c-5d1d79921957(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:54:43 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[138e5940-dcf2-4bf7-999e-3d548891e4e8]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:54:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ef61925e-c799-4807-b516-826cf18bdc9c tempest-TestStampPattern-1476496418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:54:43 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957 Sep 16 17:54:43 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:54:43 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Sep 16 17:54:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ef61925e-c799-4807-b516-826cf18bdc9c tempest-TestStampPattern-1476496418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957" returned: 0 in 0.514s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:54:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ef61925e-c799-4807-b516-826cf18bdc9c tempest-TestStampPattern-1476496418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.60df5a05-60aa-4549-af28-ebae7a6db9a2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:54:43 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.60df5a05-60aa-4549-af28-ebae7a6db9a2 Sep 16 17:54:43 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:54:44 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Sep 16 17:54:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ef61925e-c799-4807-b516-826cf18bdc9c tempest-TestStampPattern-1476496418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.60df5a05-60aa-4549-af28-ebae7a6db9a2" returned: 0 in 0.347s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:54:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ef61925e-c799-4807-b516-826cf18bdc9c tempest-TestStampPattern-1476496418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.60df5a05-60aa-4549-af28-ebae7a6db9a2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:54:44 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.60df5a05-60aa-4549-af28-ebae7a6db9a2 Sep 16 17:54:44 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:54:44 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Sep 16 17:54:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ef61925e-c799-4807-b516-826cf18bdc9c tempest-TestStampPattern-1476496418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957.60df5a05-60aa-4549-af28-ebae7a6db9a2" returned: 0 in 0.256s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:54:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ef61925e-c799-4807-b516-826cf18bdc9c tempest-TestStampPattern-1476496418 None] Lock "cinder-quobyte-60df5a05-60aa-4549-af28-ebae7a6db9a2" released by "_delete_snapshot" :: held 1.590s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:54:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ef61925e-c799-4807-b516-826cf18bdc9c tempest-TestStampPattern-1476496418 None] Lock "cinder-quobyte-a3bfcaaf-e842-4875-928c-5d1d79921957" released by "delete_snapshot" :: held 1.610s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:54:44 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-ef61925e-c799-4807-b516-826cf18bdc9c tempest-TestStampPattern-1476496418 None] Created reservations ['ff4f2cf4-4652-47e7-92f7-42ded03b20d2', 'c8e8920e-8ad3-43f1-8054-f80bddf529ee', '98dc9016-97a6-4f2b-879f-2f195f28c1ba', '735c1390-b811-4c8c-affc-e72ee773ac4f'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:54:44 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-ef61925e-c799-4807-b516-826cf18bdc9c tempest-TestStampPattern-1476496418 None] Delete snapshot completed successfully. Sep 16 17:54:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ef61925e-c799-4807-b516-826cf18bdc9c tempest-TestStampPattern-1476496418 None] Lock "cinder-60df5a05-60aa-4549-af28-ebae7a6db9a2-delete_snapshot" released by "delete_snapshot" :: held 1.745s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:54:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7bb35d5e-af72-42b7-b4cd-726ea7bf5f9c tempest-TestStampPattern-1476496418 None] Acquiring lock "cinder-a3bfcaaf-e842-4875-928c-5d1d79921957-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:54:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7bb35d5e-af72-42b7-b4cd-726ea7bf5f9c tempest-TestStampPattern-1476496418 None] Lock "cinder-a3bfcaaf-e842-4875-928c-5d1d79921957-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:54:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7bb35d5e-af72-42b7-b4cd-726ea7bf5f9c tempest-TestStampPattern-1476496418 None] Acquiring lock "cinder-quobyte-a3bfcaaf-e842-4875-928c-5d1d79921957" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:54:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7bb35d5e-af72-42b7-b4cd-726ea7bf5f9c tempest-TestStampPattern-1476496418 None] Lock "cinder-quobyte-a3bfcaaf-e842-4875-928c-5d1d79921957" acquired by "delete_volume" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:54:48 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[110263ac-bc23-4405-bece-1323f7048259]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:54:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7bb35d5e-af72-42b7-b4cd-726ea7bf5f9c tempest-TestStampPattern-1476496418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:54:48 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957 Sep 16 17:54:48 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:54:48 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Sep 16 17:54:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7bb35d5e-af72-42b7-b4cd-726ea7bf5f9c tempest-TestStampPattern-1476496418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957" returned: 0 in 0.356s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:54:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7bb35d5e-af72-42b7-b4cd-726ea7bf5f9c tempest-TestStampPattern-1476496418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:54:48 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957 Sep 16 17:54:48 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:54:49 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Sep 16 17:54:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7bb35d5e-af72-42b7-b4cd-726ea7bf5f9c tempest-TestStampPattern-1476496418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a3bfcaaf-e842-4875-928c-5d1d79921957" returned: 0 in 0.250s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:54:49 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7bb35d5e-af72-42b7-b4cd-726ea7bf5f9c tempest-TestStampPattern-1476496418 None] Lock "cinder-quobyte-a3bfcaaf-e842-4875-928c-5d1d79921957" released by "delete_volume" :: held 0.672s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:54:49 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-7bb35d5e-af72-42b7-b4cd-726ea7bf5f9c tempest-TestStampPattern-1476496418 None] Created reservations ['529df79f-23d3-437f-a2aa-fe4be771950b', 'd4613573-8d54-476c-bc35-5cbec1dcb621', '9912be86-f41d-4c26-92b9-40d899914245', '3ed901d6-6463-4f05-9081-a9f9bbe849c5'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:54:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7bb35d5e-af72-42b7-b4cd-726ea7bf5f9c tempest-TestStampPattern-1476496418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:54:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7bb35d5e-af72-42b7-b4cd-726ea7bf5f9c tempest-TestStampPattern-1476496418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:54:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7bb35d5e-af72-42b7-b4cd-726ea7bf5f9c tempest-TestStampPattern-1476496418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:54:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7bb35d5e-af72-42b7-b4cd-726ea7bf5f9c tempest-TestStampPattern-1476496418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:54:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7bb35d5e-af72-42b7-b4cd-726ea7bf5f9c tempest-TestStampPattern-1476496418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:54:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7bb35d5e-af72-42b7-b4cd-726ea7bf5f9c tempest-TestStampPattern-1476496418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:54:49 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:54:49 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:54:49 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Sep 16 17:54:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7bb35d5e-af72-42b7-b4cd-726ea7bf5f9c tempest-TestStampPattern-1476496418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.263s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:54:49 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-7bb35d5e-af72-42b7-b4cd-726ea7bf5f9c tempest-TestStampPattern-1476496418 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:54:49 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-7bb35d5e-af72-42b7-b4cd-726ea7bf5f9c tempest-TestStampPattern-1476496418 None] Deleted volume successfully. Sep 16 17:54:49 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7bb35d5e-af72-42b7-b4cd-726ea7bf5f9c tempest-TestStampPattern-1476496418 None] Lock "cinder-a3bfcaaf-e842-4875-928c-5d1d79921957-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:54:59 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=21,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:54:59 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=25,cinder:INSERT=6,cinder:UPDATE=22,cinder:DELETE=1 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:55:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:55:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:02 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:55:02 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:02 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.282s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:55:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager._thread_info {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:55:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread count: 28 {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:55:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread info: [<_MainThread(MainThread, started 123748124422272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:55:04 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:55:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Flow 'volume_create_manager' (e5357ac9-df5d-43c9-a37f-1578ef563bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc3af2a7-caa1-4b65-b1e7-a23eca40b1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc3af2a7-caa1-4b65-b1e7-a23eca40b1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d899a071-ec3a-41ef-85d4-3becf84f5660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ea8c0c4de44747b0c70606e8ca5354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:05Z,use_quota=True,user_id='46baebbff0684d5b8fab608cfa3e2c20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d663e4-8f31-4d81-8876-9dae78432142),volume_type_id=34d663e4-8f31-4d81-8876-9dae78432142)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a33a5a8-b694-4042-b81a-bcb860fa5acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a33a5a8-b694-4042-b81a-bcb860fa5acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8ca39a-c9b4-4b9c-aefa-c53ff9d90cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:04 devstack cinder-volume[85899]: DEBUG cinder.image.glance [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Creating Keystone auth plugin from conf {{(pid=85899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 17:55:05 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8ca39a-c9b4-4b9c-aefa-c53ff9d90cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd899a071-ec3a-41ef-85d4-3becf84f5660', 'volume_name': 'volume-d899a071-ec3a-41ef-85d4-3becf84f5660', 'volume_size': 1, 'image_id': '56ed044c-8e6a-4c35-8429-610474b4c107', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/56ed044c-8e6a-4c35-8429-610474b4c107', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4d167bf9239fc5d3cf18fd9674e5ea57', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '91ea8c0c4de44747b0c70606e8ca5354', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ced8ae16254403d4be6a53ad15dc4e10c6d68805b984f61fbd6236a302be1f86173f006d72b14d5cd693ecb941a113ce568552da1a970b70defd49280999102a', 'id': '56ed044c-8e6a-4c35-8429-610474b4c107', 'created_at': datetime.datetime(2026, 9, 16, 15, 55, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 55, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/56ed044c-8e6a-4c35-8429-610474b4c107/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:05 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61f88eb-5b30-4045-8973-34fe83040af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:05 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61f88eb-5b30-4045-8973-34fe83040af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:05 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1424b2-5495-4f23-b367-d5d65d340f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:05 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Volume d899a071-ec3a-41ef-85d4-3becf84f5660: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d899a071-ec3a-41ef-85d4-3becf84f5660', 'volume_size': 1, 'image_id': '56ed044c-8e6a-4c35-8429-610474b4c107', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/56ed044c-8e6a-4c35-8429-610474b4c107', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4d167bf9239fc5d3cf18fd9674e5ea57', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '91ea8c0c4de44747b0c70606e8ca5354', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ced8ae16254403d4be6a53ad15dc4e10c6d68805b984f61fbd6236a302be1f86173f006d72b14d5cd693ecb941a113ce568552da1a970b70defd49280999102a', 'id': '56ed044c-8e6a-4c35-8429-610474b4c107', 'created_at': datetime.datetime(2026, 9, 16, 15, 55, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 55, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/56ed044c-8e6a-4c35-8429-610474b4c107/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 16 17:55:05 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Trying to clone d899a071-ec3a-41ef-85d4-3becf84f5660 from image 56ed044c-8e6a-4c35-8429-610474b4c107 at location (None, [{'url': 'file:///opt/stack/data/glance/images/56ed044c-8e6a-4c35-8429-610474b4c107', 'metadata': {}}]). {{(pid=85899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 17:55:05 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 16 17:55:05 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Image download 0.00 MB at 0.00 MB/s Sep 16 17:55:05 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[881fe3ec-e664-4b1c-a972-b3f351e433f3]: (4, 'raw') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:55:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:05 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD Sep 16 17:55:05 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:05 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:05 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD Sep 16 17:55:05 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:06 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD" returned: 1 in 0.335s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:55:06 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Temporary image 56ed044c-8e6a-4c35-8429-610474b4c107 is fetched for user 46baebbff0684d5b8fab608cfa3e2c20. {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 16 17:55:06 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b788cf-28a7-4998-b854-48c5b3be7963]: (4, 'raw') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:55:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:06 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD Sep 16 17:55:06 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:06 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:06 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD Sep 16 17:55:06 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:06 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD" returned: 1 in 0.317s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:55:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:06 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d899a071-ec3a-41ef-85d4-3becf84f5660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ea8c0c4de44747b0c70606e8ca5354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:05Z,use_quota=True,user_id='46baebbff0684d5b8fab608cfa3e2c20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d663e4-8f31-4d81-8876-9dae78432142),volume_type_id=34d663e4-8f31-4d81-8876-9dae78432142)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:55:06 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Creating volume d899a071-ec3a-41ef-85d4-3becf84f5660 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:55:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:06 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:06 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:06 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:55:06 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:55:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d899a071-ec3a-41ef-85d4-3becf84f5660 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:06 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d899a071-ec3a-41ef-85d4-3becf84f5660 1073741824 Sep 16 17:55:06 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:07 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d899a071-ec3a-41ef-85d4-3becf84f5660 1073741824" returned: 0 in 0.423s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d899a071-ec3a-41ef-85d4-3becf84f5660 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:07 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d899a071-ec3a-41ef-85d4-3becf84f5660 Sep 16 17:55:07 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:07 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d899a071-ec3a-41ef-85d4-3becf84f5660" returned: 0 in 0.271s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:07 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:55:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:07 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Attempting download of 56ed044c-8e6a-4c35-8429-610474b4c107 ((None, [{'url': 'file:///opt/stack/data/glance/images/56ed044c-8e6a-4c35-8429-610474b4c107', 'metadata': {}}])) to volume d899a071-ec3a-41ef-85d4-3becf84f5660. {{(pid=85899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 17:55:07 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d490184-61ae-4b80-af26-92c7f686ac0d]: (4, 'raw') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:55:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_56ed044c-8e6a-4c35-8429-610474b4c107_o47pp2zf {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:07 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_56ed044c-8e6a-4c35-8429-610474b4c107_o47pp2zf Sep 16 17:55:07 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:07 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_56ed044c-8e6a-4c35-8429-610474b4c107_o47pp2zf" returned: 0 in 0.327s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56ed044c-8e6a-4c35-8429-610474b4c107_o47pp2zf {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:07 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56ed044c-8e6a-4c35-8429-610474b4c107_o47pp2zf Sep 16 17:55:07 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:08 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56ed044c-8e6a-4c35-8429-610474b4c107_o47pp2zf" returned: 1 in 0.324s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56ed044c-8e6a-4c35-8429-610474b4c107_o47pp2zf' failed. Not Retrying. {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:55:08 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46ab0b2-aaba-4273-a304-cfa4ce73e925]: (4, 'raw') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:55:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:08 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD Sep 16 17:55:08 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:08 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:08 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD Sep 16 17:55:08 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:08 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD" returned: 1 in 0.317s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:55:08 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] 56ed044c-8e6a-4c35-8429-610474b4c107 was raw, converting to qcow2 {{(pid=85899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 16 17:55:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d899a071-ec3a-41ef-85d4-3becf84f5660 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:08 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d899a071-ec3a-41ef-85d4-3becf84f5660 Sep 16 17:55:08 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:09 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d899a071-ec3a-41ef-85d4-3becf84f5660" returned: 0 in 0.441s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:09 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_56ed044c-8e6a-4c35-8429-610474b4c107_zg0f_o2qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d899a071-ec3a-41ef-85d4-3becf84f5660 {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:55:09 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Converted 0.00 MB image at 0.00 MB/s Sep 16 17:55:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d899a071-ec3a-41ef-85d4-3becf84f5660 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:09 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d899a071-ec3a-41ef-85d4-3becf84f5660 1G Sep 16 17:55:09 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:09 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d899a071-ec3a-41ef-85d4-3becf84f5660 1G" returned: 0 in 0.311s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:09 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Downloaded image 56ed044c-8e6a-4c35-8429-610474b4c107 ((None, [{'url': 'file:///opt/stack/data/glance/images/56ed044c-8e6a-4c35-8429-610474b4c107', 'metadata': {}}])) to volume d899a071-ec3a-41ef-85d4-3becf84f5660 successfully. {{(pid=85899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 17:55:09 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Temporary image 56ed044c-8e6a-4c35-8429-610474b4c107 for user 46baebbff0684d5b8fab608cfa3e2c20 is deleted. {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 16 17:55:09 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Marking volume d899a071-ec3a-41ef-85d4-3becf84f5660 as bootable. {{(pid=85899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 17:55:09 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Copying metadata from image 56ed044c-8e6a-4c35-8429-610474b4c107 to d899a071-ec3a-41ef-85d4-3becf84f5660. {{(pid=85899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 17:55:09 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Creating volume glance metadata for volume d899a071-ec3a-41ef-85d4-3becf84f5660 backed by image 56ed044c-8e6a-4c35-8429-610474b4c107 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '56ed044c-8e6a-4c35-8429-610474b4c107', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4d167bf9239fc5d3cf18fd9674e5ea57', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 17:55:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1424b2-5495-4f23-b367-d5d65d340f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d899a071-ec3a-41ef-85d4-3becf84f5660', 'volume_size': 1, 'image_id': '56ed044c-8e6a-4c35-8429-610474b4c107', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/56ed044c-8e6a-4c35-8429-610474b4c107', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4d167bf9239fc5d3cf18fd9674e5ea57', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '91ea8c0c4de44747b0c70606e8ca5354', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ced8ae16254403d4be6a53ad15dc4e10c6d68805b984f61fbd6236a302be1f86173f006d72b14d5cd693ecb941a113ce568552da1a970b70defd49280999102a', 'id': '56ed044c-8e6a-4c35-8429-610474b4c107', 'created_at': datetime.datetime(2026, 9, 16, 15, 55, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 55, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/56ed044c-8e6a-4c35-8429-610474b4c107/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999fbb0f-ef67-4982-90f0-124a0449dfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:09 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Volume volume-d899a071-ec3a-41ef-85d4-3becf84f5660 (d899a071-ec3a-41ef-85d4-3becf84f5660): created successfully Sep 16 17:55:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999fbb0f-ef67-4982-90f0-124a0449dfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Flow 'volume_create_manager' (e5357ac9-df5d-43c9-a37f-1578ef563bc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:09 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-4fe2459b-ec39-42b8-b1f1-850e510df0c7 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Created volume successfully. Sep 16 17:55:10 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-202b5194-a902-4853-9d4f-638bb3bb2477 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Acquiring lock "cinder-d899a071-ec3a-41ef-85d4-3becf84f5660-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:10 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-202b5194-a902-4853-9d4f-638bb3bb2477 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Lock "cinder-d899a071-ec3a-41ef-85d4-3becf84f5660-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:10 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-202b5194-a902-4853-9d4f-638bb3bb2477 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Acquiring lock "cinder-quobyte-d899a071-ec3a-41ef-85d4-3becf84f5660" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:10 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-202b5194-a902-4853-9d4f-638bb3bb2477 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Lock "cinder-quobyte-d899a071-ec3a-41ef-85d4-3becf84f5660" acquired by "delete_volume" :: waited 0.014s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:10 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[151d5640-3153-4748-b9a6-194d16bc5e8d]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:55:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-202b5194-a902-4853-9d4f-638bb3bb2477 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d899a071-ec3a-41ef-85d4-3becf84f5660 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:10 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d899a071-ec3a-41ef-85d4-3becf84f5660 Sep 16 17:55:10 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:10 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-202b5194-a902-4853-9d4f-638bb3bb2477 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d899a071-ec3a-41ef-85d4-3becf84f5660" returned: 0 in 0.390s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-202b5194-a902-4853-9d4f-638bb3bb2477 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d899a071-ec3a-41ef-85d4-3becf84f5660 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:10 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d899a071-ec3a-41ef-85d4-3becf84f5660 Sep 16 17:55:10 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:10 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-202b5194-a902-4853-9d4f-638bb3bb2477 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d899a071-ec3a-41ef-85d4-3becf84f5660" returned: 0 in 0.266s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:10 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-202b5194-a902-4853-9d4f-638bb3bb2477 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Lock "cinder-quobyte-d899a071-ec3a-41ef-85d4-3becf84f5660" released by "delete_volume" :: held 0.696s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:10 devstack cinder-volume[85899]: WARNING cinder.quota [None req-202b5194-a902-4853-9d4f-638bb3bb2477 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:55:10 devstack cinder-volume[85899]: WARNING cinder.quota [None req-202b5194-a902-4853-9d4f-638bb3bb2477 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 16 17:55:10 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-202b5194-a902-4853-9d4f-638bb3bb2477 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Created reservations ['0cafc60c-d24e-403e-b634-e067d4bf5b2c', '7f00e50b-d370-4bf3-bd53-8142c71ef2fb', 'f3cad880-7035-447c-a909-00e034ed4515', '63e001cb-c548-452b-958a-28558fb04dea'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:55:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-202b5194-a902-4853-9d4f-638bb3bb2477 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-202b5194-a902-4853-9d4f-638bb3bb2477 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-202b5194-a902-4853-9d4f-638bb3bb2477 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-202b5194-a902-4853-9d4f-638bb3bb2477 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-202b5194-a902-4853-9d4f-638bb3bb2477 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-202b5194-a902-4853-9d4f-638bb3bb2477 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:10 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:55:10 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:11 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-202b5194-a902-4853-9d4f-638bb3bb2477 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.248s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:11 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-202b5194-a902-4853-9d4f-638bb3bb2477 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:55:11 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-202b5194-a902-4853-9d4f-638bb3bb2477 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Deleted volume successfully. Sep 16 17:55:11 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-202b5194-a902-4853-9d4f-638bb3bb2477 tempest-VolumeAndVolumeTypeFromImageTest-1920182533 None] Lock "cinder-d899a071-ec3a-41ef-85d4-3becf84f5660-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Flow 'volume_create_manager' (8e4f4579-22eb-43f2-92ea-200c8cebba03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143c4bb5-1399-47f1-a660-091cea6221e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143c4bb5-1399-47f1-a660-091cea6221e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-628254093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=923706e3-847d-4a4c-890b-4f1b8d8c6198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8bf9b48020407787c5984eac4abe88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:15Z,use_quota=True,user_id='fed08d5997a94062b82d3a8929b7ed20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49005637-604f-491f-899d-c535a1efd287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49005637-604f-491f-899d-c535a1efd287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (281c04ff-33ec-4551-a861-6941b040f6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (281c04ff-33ec-4551-a861-6941b040f6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '923706e3-847d-4a4c-890b-4f1b8d8c6198', 'volume_name': 'volume-923706e3-847d-4a4c-890b-4f1b8d8c6198', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db961a14-3ad6-423d-8215-a26d02b5b805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db961a14-3ad6-423d-8215-a26d02b5b805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772b2247-d3ee-4b57-92b7-61ec6f67b89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:15 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Volume 923706e3-847d-4a4c-890b-4f1b8d8c6198: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-923706e3-847d-4a4c-890b-4f1b8d8c6198', 'volume_size': 1} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-628254093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=923706e3-847d-4a4c-890b-4f1b8d8c6198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8bf9b48020407787c5984eac4abe88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:15Z,use_quota=True,user_id='fed08d5997a94062b82d3a8929b7ed20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Creating volume 923706e3-847d-4a4c-890b-4f1b8d8c6198 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:55:15 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-923706e3-847d-4a4c-890b-4f1b8d8c6198 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:15 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-923706e3-847d-4a4c-890b-4f1b8d8c6198 1073741824 Sep 16 17:55:15 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Flow 'volume_create_manager' (6c0b95ee-ade5-402a-9614-53af6ded52e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de10865-11d4-41e7-8850-ce2d890991e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de10865-11d4-41e7-8850-ce2d890991e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-542262169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a1b052-80f0-452c-a1e8-7dd87aa05e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8bf9b48020407787c5984eac4abe88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:16Z,use_quota=True,user_id='fed08d5997a94062b82d3a8929b7ed20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c7155e-f13d-4e4d-b5ab-2926ab0ccb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c7155e-f13d-4e4d-b5ab-2926ab0ccb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7cdd75-fa76-4721-918c-8234424b51fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7cdd75-fa76-4721-918c-8234424b51fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4a1b052-80f0-452c-a1e8-7dd87aa05e23', 'volume_name': 'volume-c4a1b052-80f0-452c-a1e8-7dd87aa05e23', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f3b5ea-cbce-4ce8-8514-10c65131b9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f3b5ea-cbce-4ce8-8514-10c65131b9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d297ba40-5e66-4da7-a371-0cc41f435113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:15 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Volume c4a1b052-80f0-452c-a1e8-7dd87aa05e23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4a1b052-80f0-452c-a1e8-7dd87aa05e23', 'volume_size': 1} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:15 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-923706e3-847d-4a4c-890b-4f1b8d8c6198 1073741824" returned: 0 in 0.492s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-923706e3-847d-4a4c-890b-4f1b8d8c6198 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:15 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-923706e3-847d-4a4c-890b-4f1b8d8c6198 Sep 16 17:55:15 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Flow 'volume_create_manager' (a903caa0-07ce-4a65-855e-4f99bba56ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa02589-3022-4844-9c57-0a386833172e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa02589-3022-4844-9c57-0a386833172e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1548282837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0362b048-d368-429e-8bf7-602b0d686af6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8bf9b48020407787c5984eac4abe88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:16Z,use_quota=True,user_id='fed08d5997a94062b82d3a8929b7ed20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839f753d-d742-49eb-a281-de586ed97231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839f753d-d742-49eb-a281-de586ed97231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa079a1-5fb9-47af-a3ef-86d8497d150a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa079a1-5fb9-47af-a3ef-86d8497d150a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0362b048-d368-429e-8bf7-602b0d686af6', 'volume_name': 'volume-0362b048-d368-429e-8bf7-602b0d686af6', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6edc1935-76a5-4b49-b226-10348ab1177a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6edc1935-76a5-4b49-b226-10348ab1177a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3714e6-d426-45ea-80df-ae8c99cf52ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:16 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Volume 0362b048-d368-429e-8bf7-602b0d686af6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0362b048-d368-429e-8bf7-602b0d686af6', 'volume_size': 1} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:16 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-923706e3-847d-4a4c-890b-4f1b8d8c6198" returned: 0 in 0.252s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.400s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-542262169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a1b052-80f0-452c-a1e8-7dd87aa05e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8bf9b48020407787c5984eac4abe88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:16Z,use_quota=True,user_id='fed08d5997a94062b82d3a8929b7ed20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Creating volume c4a1b052-80f0-452c-a1e8-7dd87aa05e23 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:55:16 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-c4a1b052-80f0-452c-a1e8-7dd87aa05e23 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772b2247-d3ee-4b57-92b7-61ec6f67b89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-923706e3-847d-4a4c-890b-4f1b8d8c6198', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:16 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-c4a1b052-80f0-452c-a1e8-7dd87aa05e23 1073741824 Sep 16 17:55:16 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578cc0c5-ec11-4bfd-81f5-7c31f8d6ce64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:16 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Volume volume-923706e3-847d-4a4c-890b-4f1b8d8c6198 (923706e3-847d-4a4c-890b-4f1b8d8c6198): created successfully Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578cc0c5-ec11-4bfd-81f5-7c31f8d6ce64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Flow 'volume_create_manager' (8e4f4579-22eb-43f2-92ea-200c8cebba03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:16 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-033b5246-71bd-461f-8a27-9ab7ab52f0d2 tempest-CreateVolumesFromImageTest-1475985592 None] Created volume successfully. Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Flow 'volume_create_manager' (43943b25-680d-4fdb-8592-d6c2a7365afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b8d9f1-d3a4-41f7-81a6-93788ac896b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b8d9f1-d3a4-41f7-81a6-93788ac896b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1907627446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2629556-3fe2-4f92-9fd1-200c560e5544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8bf9b48020407787c5984eac4abe88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:16Z,use_quota=True,user_id='fed08d5997a94062b82d3a8929b7ed20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1b4e60-0a2a-4c0e-8de7-573940e43088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1b4e60-0a2a-4c0e-8de7-573940e43088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a37d662-74bf-4266-bcb9-64daa1fb1743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a37d662-74bf-4266-bcb9-64daa1fb1743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2629556-3fe2-4f92-9fd1-200c560e5544', 'volume_name': 'volume-d2629556-3fe2-4f92-9fd1-200c560e5544', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5853afc7-9041-466c-b404-a5aea19d332c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5853afc7-9041-466c-b404-a5aea19d332c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b64a5e-88d2-4758-9dc8-484b4ceb8570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:16 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Volume d2629556-3fe2-4f92-9fd1-200c560e5544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2629556-3fe2-4f92-9fd1-200c560e5544', 'volume_size': 1} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:16 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-c4a1b052-80f0-452c-a1e8-7dd87aa05e23 1073741824" returned: 0 in 0.579s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-c4a1b052-80f0-452c-a1e8-7dd87aa05e23 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:55:16 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-c4a1b052-80f0-452c-a1e8-7dd87aa05e23 Sep 16 17:55:16 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Flow 'volume_create_manager' (330e3b98-6a91-4708-b9ec-e55f2d7c4aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d32fa69e-6a0e-453b-ba05-f93ee7f327fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d32fa69e-6a0e-453b-ba05-f93ee7f327fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1316148754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d53c86-a60e-42cb-b43e-5e5e529c875c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8bf9b48020407787c5984eac4abe88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:17Z,use_quota=True,user_id='fed08d5997a94062b82d3a8929b7ed20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ecc092-b1fc-4a36-b80d-ca802d8393d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ecc092-b1fc-4a36-b80d-ca802d8393d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2204b063-2a6f-4249-8314-7ed4d4d0c846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2204b063-2a6f-4249-8314-7ed4d4d0c846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2d53c86-a60e-42cb-b43e-5e5e529c875c', 'volume_name': 'volume-d2d53c86-a60e-42cb-b43e-5e5e529c875c', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f385744e-602e-49e0-8732-b684936463ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f385744e-602e-49e0-8732-b684936463ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a33a9e6-d57b-4011-a0ad-fc2fa7cfd9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:16 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Volume d2d53c86-a60e-42cb-b43e-5e5e529c875c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2d53c86-a60e-42cb-b43e-5e5e529c875c', 'volume_size': 1} Sep 16 17:55:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:17 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-c4a1b052-80f0-452c-a1e8-7dd87aa05e23" returned: 0 in 0.259s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.909s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1548282837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0362b048-d368-429e-8bf7-602b0d686af6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8bf9b48020407787c5984eac4abe88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:16Z,use_quota=True,user_id='fed08d5997a94062b82d3a8929b7ed20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Creating volume 0362b048-d368-429e-8bf7-602b0d686af6 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:55:17 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0362b048-d368-429e-8bf7-602b0d686af6 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d297ba40-5e66-4da7-a371-0cc41f435113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4a1b052-80f0-452c-a1e8-7dd87aa05e23', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:17 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0362b048-d368-429e-8bf7-602b0d686af6 1073741824 Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9bcbdf-a12c-4a75-b458-361010a5ce24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:17 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:17 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Volume volume-c4a1b052-80f0-452c-a1e8-7dd87aa05e23 (c4a1b052-80f0-452c-a1e8-7dd87aa05e23): created successfully Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9bcbdf-a12c-4a75-b458-361010a5ce24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Flow 'volume_create_manager' (6c0b95ee-ade5-402a-9614-53af6ded52e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:17 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-6520ef96-5f30-4509-b3c1-d118ad343213 tempest-CreateVolumesFromImageTest-1475985592 None] Created volume successfully. Sep 16 17:55:17 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0362b048-d368-429e-8bf7-602b0d686af6 1073741824" returned: 0 in 0.451s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0362b048-d368-429e-8bf7-602b0d686af6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:17 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0362b048-d368-429e-8bf7-602b0d686af6 Sep 16 17:55:17 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:17 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0362b048-d368-429e-8bf7-602b0d686af6" returned: 0 in 0.252s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.248s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1907627446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2629556-3fe2-4f92-9fd1-200c560e5544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8bf9b48020407787c5984eac4abe88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:16Z,use_quota=True,user_id='fed08d5997a94062b82d3a8929b7ed20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Creating volume d2629556-3fe2-4f92-9fd1-200c560e5544 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:55:17 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2629556-3fe2-4f92-9fd1-200c560e5544 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3714e6-d426-45ea-80df-ae8c99cf52ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0362b048-d368-429e-8bf7-602b0d686af6', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:17 devstack sudo[104213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2629556-3fe2-4f92-9fd1-200c560e5544 1073741824 Sep 16 17:55:17 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3c3dd5-a6ba-4dae-b9a7-65de5813bb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:17 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Volume volume-0362b048-d368-429e-8bf7-602b0d686af6 (0362b048-d368-429e-8bf7-602b0d686af6): created successfully Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3c3dd5-a6ba-4dae-b9a7-65de5813bb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Flow 'volume_create_manager' (a903caa0-07ce-4a65-855e-4f99bba56ae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:17 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-019ce871-2e1d-4386-8da2-f5bfed6c6efc tempest-CreateVolumesFromImageTest-1475985592 None] Created volume successfully. Sep 16 17:55:18 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2629556-3fe2-4f92-9fd1-200c560e5544 1073741824" returned: 0 in 0.419s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2629556-3fe2-4f92-9fd1-200c560e5544 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:18 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2629556-3fe2-4f92-9fd1-200c560e5544 Sep 16 17:55:18 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:18 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2629556-3fe2-4f92-9fd1-200c560e5544" returned: 0 in 0.259s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:55:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.669s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1316148754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d53c86-a60e-42cb-b43e-5e5e529c875c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8bf9b48020407787c5984eac4abe88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:17Z,use_quota=True,user_id='fed08d5997a94062b82d3a8929b7ed20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:55:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Creating volume d2d53c86-a60e-42cb-b43e-5e5e529c875c {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:55:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:55:18 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:55:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2d53c86-a60e-42cb-b43e-5e5e529c875c 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b64a5e-88d2-4758-9dc8-484b4ceb8570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2629556-3fe2-4f92-9fd1-200c560e5544', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:18 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2d53c86-a60e-42cb-b43e-5e5e529c875c 1073741824 Sep 16 17:55:18 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf21bf50-64c4-4af4-8311-daeef57de722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:18 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Volume volume-d2629556-3fe2-4f92-9fd1-200c560e5544 (d2629556-3fe2-4f92-9fd1-200c560e5544): created successfully Sep 16 17:55:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf21bf50-64c4-4af4-8311-daeef57de722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Flow 'volume_create_manager' (43943b25-680d-4fdb-8592-d6c2a7365afa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:18 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-a0b78b10-4f2a-412b-9b88-23fc4cf4d96a tempest-CreateVolumesFromImageTest-1475985592 None] Created volume successfully. Sep 16 17:55:19 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2d53c86-a60e-42cb-b43e-5e5e529c875c 1073741824" returned: 0 in 0.414s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2d53c86-a60e-42cb-b43e-5e5e529c875c {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:19 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2d53c86-a60e-42cb-b43e-5e5e529c875c Sep 16 17:55:19 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:19 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2d53c86-a60e-42cb-b43e-5e5e529c875c" returned: 0 in 0.274s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:19 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:55:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a33a9e6-d57b-4011-a0ad-fc2fa7cfd9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2d53c86-a60e-42cb-b43e-5e5e529c875c', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21c168e-501a-4f7d-a9cb-47e188d1c56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:19 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Volume volume-d2d53c86-a60e-42cb-b43e-5e5e529c875c (d2d53c86-a60e-42cb-b43e-5e5e529c875c): created successfully Sep 16 17:55:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21c168e-501a-4f7d-a9cb-47e188d1c56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Flow 'volume_create_manager' (330e3b98-6a91-4708-b9ec-e55f2d7c4aa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:19 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-e31e3fa7-0e9c-4b3a-8629-be84015b2a99 tempest-CreateVolumesFromImageTest-1475985592 None] Created volume successfully. Sep 16 17:55:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-43879a18-0a14-4bf2-9a0e-4e6f9b9140b6 tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "cinder-d2d53c86-a60e-42cb-b43e-5e5e529c875c-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-43879a18-0a14-4bf2-9a0e-4e6f9b9140b6 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "cinder-d2d53c86-a60e-42cb-b43e-5e5e529c875c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-43879a18-0a14-4bf2-9a0e-4e6f9b9140b6 tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "cinder-quobyte-d2d53c86-a60e-42cb-b43e-5e5e529c875c" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-43879a18-0a14-4bf2-9a0e-4e6f9b9140b6 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "cinder-quobyte-d2d53c86-a60e-42cb-b43e-5e5e529c875c" acquired by "delete_volume" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:20 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee87f71f-a27d-4bf7-89b9-380c69f8c614]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:55:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-43879a18-0a14-4bf2-9a0e-4e6f9b9140b6 tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2d53c86-a60e-42cb-b43e-5e5e529c875c {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:20 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2d53c86-a60e-42cb-b43e-5e5e529c875c Sep 16 17:55:20 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:20 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-43879a18-0a14-4bf2-9a0e-4e6f9b9140b6 tempest-CreateVolumesFromImageTest-1475985592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2d53c86-a60e-42cb-b43e-5e5e529c875c" returned: 0 in 0.378s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-43879a18-0a14-4bf2-9a0e-4e6f9b9140b6 tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2d53c86-a60e-42cb-b43e-5e5e529c875c {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:20 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2d53c86-a60e-42cb-b43e-5e5e529c875c Sep 16 17:55:20 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:21 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-43879a18-0a14-4bf2-9a0e-4e6f9b9140b6 tempest-CreateVolumesFromImageTest-1475985592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2d53c86-a60e-42cb-b43e-5e5e529c875c" returned: 0 in 0.262s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-43879a18-0a14-4bf2-9a0e-4e6f9b9140b6 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "cinder-quobyte-d2d53c86-a60e-42cb-b43e-5e5e529c875c" released by "delete_volume" :: held 0.684s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:21 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-43879a18-0a14-4bf2-9a0e-4e6f9b9140b6 tempest-CreateVolumesFromImageTest-1475985592 None] Created reservations ['f909161a-179b-4220-8225-aa31aa94d234', '227497fd-b57a-4d3c-976c-089804fb5f3b', 'dff9784c-a1b2-44af-9d3e-c65723c0f213', 'eba25252-abc8-42fb-b4ff-92c0b172feab'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:55:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-43879a18-0a14-4bf2-9a0e-4e6f9b9140b6 tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-43879a18-0a14-4bf2-9a0e-4e6f9b9140b6 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-43879a18-0a14-4bf2-9a0e-4e6f9b9140b6 tempest-CreateVolumesFromImageTest-1475985592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-43879a18-0a14-4bf2-9a0e-4e6f9b9140b6 tempest-CreateVolumesFromImageTest-1475985592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-43879a18-0a14-4bf2-9a0e-4e6f9b9140b6 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-43879a18-0a14-4bf2-9a0e-4e6f9b9140b6 tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:21 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:55:21 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:21 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-43879a18-0a14-4bf2-9a0e-4e6f9b9140b6 tempest-CreateVolumesFromImageTest-1475985592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.260s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:21 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-43879a18-0a14-4bf2-9a0e-4e6f9b9140b6 tempest-CreateVolumesFromImageTest-1475985592 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:55:21 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-43879a18-0a14-4bf2-9a0e-4e6f9b9140b6 tempest-CreateVolumesFromImageTest-1475985592 None] Deleted volume successfully. Sep 16 17:55:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-43879a18-0a14-4bf2-9a0e-4e6f9b9140b6 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "cinder-d2d53c86-a60e-42cb-b43e-5e5e529c875c-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-eabc3519-5b25-4cab-9d54-c1f9de5035b0 tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "cinder-d2629556-3fe2-4f92-9fd1-200c560e5544-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-eabc3519-5b25-4cab-9d54-c1f9de5035b0 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "cinder-d2629556-3fe2-4f92-9fd1-200c560e5544-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-eabc3519-5b25-4cab-9d54-c1f9de5035b0 tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "cinder-quobyte-d2629556-3fe2-4f92-9fd1-200c560e5544" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-eabc3519-5b25-4cab-9d54-c1f9de5035b0 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "cinder-quobyte-d2629556-3fe2-4f92-9fd1-200c560e5544" acquired by "delete_volume" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:21 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0533f6ff-ebfc-41d0-a44a-abb649016553]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:55:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-eabc3519-5b25-4cab-9d54-c1f9de5035b0 tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2629556-3fe2-4f92-9fd1-200c560e5544 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:21 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2629556-3fe2-4f92-9fd1-200c560e5544 Sep 16 17:55:21 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:22 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-eabc3519-5b25-4cab-9d54-c1f9de5035b0 tempest-CreateVolumesFromImageTest-1475985592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2629556-3fe2-4f92-9fd1-200c560e5544" returned: 0 in 0.366s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-eabc3519-5b25-4cab-9d54-c1f9de5035b0 tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2629556-3fe2-4f92-9fd1-200c560e5544 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:22 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2629556-3fe2-4f92-9fd1-200c560e5544 Sep 16 17:55:22 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:22 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-eabc3519-5b25-4cab-9d54-c1f9de5035b0 tempest-CreateVolumesFromImageTest-1475985592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d2629556-3fe2-4f92-9fd1-200c560e5544" returned: 0 in 0.249s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-eabc3519-5b25-4cab-9d54-c1f9de5035b0 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "cinder-quobyte-d2629556-3fe2-4f92-9fd1-200c560e5544" released by "delete_volume" :: held 0.659s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:22 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-eabc3519-5b25-4cab-9d54-c1f9de5035b0 tempest-CreateVolumesFromImageTest-1475985592 None] Created reservations ['7cfc58de-bcac-4bf7-ac83-bd75ef885cf3', '34417f5f-e376-409c-8c02-a312a0e2175f', '0726188c-8e3b-4693-8c39-f149c40b58b9', '6f7ea1be-ce5f-4502-919f-a0295ce68131'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:55:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-eabc3519-5b25-4cab-9d54-c1f9de5035b0 tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-eabc3519-5b25-4cab-9d54-c1f9de5035b0 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-eabc3519-5b25-4cab-9d54-c1f9de5035b0 tempest-CreateVolumesFromImageTest-1475985592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-eabc3519-5b25-4cab-9d54-c1f9de5035b0 tempest-CreateVolumesFromImageTest-1475985592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-eabc3519-5b25-4cab-9d54-c1f9de5035b0 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-eabc3519-5b25-4cab-9d54-c1f9de5035b0 tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:22 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:55:22 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:22 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-eabc3519-5b25-4cab-9d54-c1f9de5035b0 tempest-CreateVolumesFromImageTest-1475985592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.289s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:22 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-eabc3519-5b25-4cab-9d54-c1f9de5035b0 tempest-CreateVolumesFromImageTest-1475985592 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:55:22 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-eabc3519-5b25-4cab-9d54-c1f9de5035b0 tempest-CreateVolumesFromImageTest-1475985592 None] Deleted volume successfully. Sep 16 17:55:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-eabc3519-5b25-4cab-9d54-c1f9de5035b0 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "cinder-d2629556-3fe2-4f92-9fd1-200c560e5544-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7419d130-c570-49fd-a763-1d82e7e19a5a tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "cinder-0362b048-d368-429e-8bf7-602b0d686af6-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7419d130-c570-49fd-a763-1d82e7e19a5a tempest-CreateVolumesFromImageTest-1475985592 None] Lock "cinder-0362b048-d368-429e-8bf7-602b0d686af6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7419d130-c570-49fd-a763-1d82e7e19a5a tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "cinder-quobyte-0362b048-d368-429e-8bf7-602b0d686af6" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7419d130-c570-49fd-a763-1d82e7e19a5a tempest-CreateVolumesFromImageTest-1475985592 None] Lock "cinder-quobyte-0362b048-d368-429e-8bf7-602b0d686af6" acquired by "delete_volume" :: waited 0.015s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:22 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8d644a-158a-48d9-aa66-267e4a2e150e]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:55:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7419d130-c570-49fd-a763-1d82e7e19a5a tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0362b048-d368-429e-8bf7-602b0d686af6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:23 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0362b048-d368-429e-8bf7-602b0d686af6 Sep 16 17:55:23 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:23 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7419d130-c570-49fd-a763-1d82e7e19a5a tempest-CreateVolumesFromImageTest-1475985592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0362b048-d368-429e-8bf7-602b0d686af6" returned: 0 in 0.391s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7419d130-c570-49fd-a763-1d82e7e19a5a tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0362b048-d368-429e-8bf7-602b0d686af6 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:23 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0362b048-d368-429e-8bf7-602b0d686af6 Sep 16 17:55:23 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:23 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7419d130-c570-49fd-a763-1d82e7e19a5a tempest-CreateVolumesFromImageTest-1475985592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0362b048-d368-429e-8bf7-602b0d686af6" returned: 0 in 0.254s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7419d130-c570-49fd-a763-1d82e7e19a5a tempest-CreateVolumesFromImageTest-1475985592 None] Lock "cinder-quobyte-0362b048-d368-429e-8bf7-602b0d686af6" released by "delete_volume" :: held 0.688s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:23 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-7419d130-c570-49fd-a763-1d82e7e19a5a tempest-CreateVolumesFromImageTest-1475985592 None] Created reservations ['573bd7f7-463c-46fd-a40c-a1893ca37ed6', 'f2e3be63-6e5c-4287-b984-681392d8bf18', '900e30f1-b485-4240-af61-0891af4dd68b', '76633ced-0020-498e-ac1a-0dd276b04126'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:55:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7419d130-c570-49fd-a763-1d82e7e19a5a tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7419d130-c570-49fd-a763-1d82e7e19a5a tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7419d130-c570-49fd-a763-1d82e7e19a5a tempest-CreateVolumesFromImageTest-1475985592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7419d130-c570-49fd-a763-1d82e7e19a5a tempest-CreateVolumesFromImageTest-1475985592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7419d130-c570-49fd-a763-1d82e7e19a5a tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7419d130-c570-49fd-a763-1d82e7e19a5a tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:23 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:55:23 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:23 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7419d130-c570-49fd-a763-1d82e7e19a5a tempest-CreateVolumesFromImageTest-1475985592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.254s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:23 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-7419d130-c570-49fd-a763-1d82e7e19a5a tempest-CreateVolumesFromImageTest-1475985592 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:55:24 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-7419d130-c570-49fd-a763-1d82e7e19a5a tempest-CreateVolumesFromImageTest-1475985592 None] Deleted volume successfully. Sep 16 17:55:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-1088d917-8659-427e-9fc3-5aa7c73ab6b4 tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "cinder-c4a1b052-80f0-452c-a1e8-7dd87aa05e23-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7419d130-c570-49fd-a763-1d82e7e19a5a tempest-CreateVolumesFromImageTest-1475985592 None] Lock "cinder-0362b048-d368-429e-8bf7-602b0d686af6-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-1088d917-8659-427e-9fc3-5aa7c73ab6b4 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "cinder-c4a1b052-80f0-452c-a1e8-7dd87aa05e23-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-1088d917-8659-427e-9fc3-5aa7c73ab6b4 tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "cinder-quobyte-c4a1b052-80f0-452c-a1e8-7dd87aa05e23" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-1088d917-8659-427e-9fc3-5aa7c73ab6b4 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "cinder-quobyte-c4a1b052-80f0-452c-a1e8-7dd87aa05e23" acquired by "delete_volume" :: waited 0.014s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:24 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[25393829-e10f-4ea5-9364-dfcd3c1b8cca]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:55:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1088d917-8659-427e-9fc3-5aa7c73ab6b4 tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-c4a1b052-80f0-452c-a1e8-7dd87aa05e23 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:24 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-c4a1b052-80f0-452c-a1e8-7dd87aa05e23 Sep 16 17:55:24 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:24 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1088d917-8659-427e-9fc3-5aa7c73ab6b4 tempest-CreateVolumesFromImageTest-1475985592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-c4a1b052-80f0-452c-a1e8-7dd87aa05e23" returned: 0 in 0.385s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1088d917-8659-427e-9fc3-5aa7c73ab6b4 tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-c4a1b052-80f0-452c-a1e8-7dd87aa05e23 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:24 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-c4a1b052-80f0-452c-a1e8-7dd87aa05e23 Sep 16 17:55:24 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:24 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1088d917-8659-427e-9fc3-5aa7c73ab6b4 tempest-CreateVolumesFromImageTest-1475985592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-c4a1b052-80f0-452c-a1e8-7dd87aa05e23" returned: 0 in 0.258s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-1088d917-8659-427e-9fc3-5aa7c73ab6b4 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "cinder-quobyte-c4a1b052-80f0-452c-a1e8-7dd87aa05e23" released by "delete_volume" :: held 0.686s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:24 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-1088d917-8659-427e-9fc3-5aa7c73ab6b4 tempest-CreateVolumesFromImageTest-1475985592 None] Created reservations ['40c896ae-a5f0-4992-a379-3be997af1509', '69ae47d6-c0c5-4823-a532-6709f462a1d1', '347ce34b-73cd-458a-8ca3-7690b10da7e9', 'c0f72b4c-2584-444f-a821-6de35003e88a'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:55:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1088d917-8659-427e-9fc3-5aa7c73ab6b4 tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1088d917-8659-427e-9fc3-5aa7c73ab6b4 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-1088d917-8659-427e-9fc3-5aa7c73ab6b4 tempest-CreateVolumesFromImageTest-1475985592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-1088d917-8659-427e-9fc3-5aa7c73ab6b4 tempest-CreateVolumesFromImageTest-1475985592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1088d917-8659-427e-9fc3-5aa7c73ab6b4 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1088d917-8659-427e-9fc3-5aa7c73ab6b4 tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:24 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:55:24 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:25 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1088d917-8659-427e-9fc3-5aa7c73ab6b4 tempest-CreateVolumesFromImageTest-1475985592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.257s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:25 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-1088d917-8659-427e-9fc3-5aa7c73ab6b4 tempest-CreateVolumesFromImageTest-1475985592 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:55:25 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-1088d917-8659-427e-9fc3-5aa7c73ab6b4 tempest-CreateVolumesFromImageTest-1475985592 None] Deleted volume successfully. Sep 16 17:55:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-42077977-f1a1-4aea-98ed-1b1acf2c6eed tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "cinder-923706e3-847d-4a4c-890b-4f1b8d8c6198-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-1088d917-8659-427e-9fc3-5aa7c73ab6b4 tempest-CreateVolumesFromImageTest-1475985592 None] Lock "cinder-c4a1b052-80f0-452c-a1e8-7dd87aa05e23-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-42077977-f1a1-4aea-98ed-1b1acf2c6eed tempest-CreateVolumesFromImageTest-1475985592 None] Lock "cinder-923706e3-847d-4a4c-890b-4f1b8d8c6198-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-42077977-f1a1-4aea-98ed-1b1acf2c6eed tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "cinder-quobyte-923706e3-847d-4a4c-890b-4f1b8d8c6198" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-42077977-f1a1-4aea-98ed-1b1acf2c6eed tempest-CreateVolumesFromImageTest-1475985592 None] Lock "cinder-quobyte-923706e3-847d-4a4c-890b-4f1b8d8c6198" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:25 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da08c32-9490-4e70-b087-2f92f247921f]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:55:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-42077977-f1a1-4aea-98ed-1b1acf2c6eed tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-923706e3-847d-4a4c-890b-4f1b8d8c6198 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:25 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-923706e3-847d-4a4c-890b-4f1b8d8c6198 Sep 16 17:55:25 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:25 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-42077977-f1a1-4aea-98ed-1b1acf2c6eed tempest-CreateVolumesFromImageTest-1475985592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-923706e3-847d-4a4c-890b-4f1b8d8c6198" returned: 0 in 0.363s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-42077977-f1a1-4aea-98ed-1b1acf2c6eed tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-923706e3-847d-4a4c-890b-4f1b8d8c6198 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:25 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-923706e3-847d-4a4c-890b-4f1b8d8c6198 Sep 16 17:55:25 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:25 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-42077977-f1a1-4aea-98ed-1b1acf2c6eed tempest-CreateVolumesFromImageTest-1475985592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-923706e3-847d-4a4c-890b-4f1b8d8c6198" returned: 0 in 0.239s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-42077977-f1a1-4aea-98ed-1b1acf2c6eed tempest-CreateVolumesFromImageTest-1475985592 None] Lock "cinder-quobyte-923706e3-847d-4a4c-890b-4f1b8d8c6198" released by "delete_volume" :: held 0.640s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:25 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-42077977-f1a1-4aea-98ed-1b1acf2c6eed tempest-CreateVolumesFromImageTest-1475985592 None] Created reservations ['d3438bd6-00f8-4ce8-883d-baaf9f3af7ed', '1a0d75c5-88ce-4948-a320-91b527278aa9', 'ffe41118-e7e8-4e9c-89f2-844412e49953', 'f5d4e6a0-8ebd-40c2-8731-18c31ca4d877'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:55:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-42077977-f1a1-4aea-98ed-1b1acf2c6eed tempest-CreateVolumesFromImageTest-1475985592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-42077977-f1a1-4aea-98ed-1b1acf2c6eed tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-42077977-f1a1-4aea-98ed-1b1acf2c6eed tempest-CreateVolumesFromImageTest-1475985592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-42077977-f1a1-4aea-98ed-1b1acf2c6eed tempest-CreateVolumesFromImageTest-1475985592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-42077977-f1a1-4aea-98ed-1b1acf2c6eed tempest-CreateVolumesFromImageTest-1475985592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-42077977-f1a1-4aea-98ed-1b1acf2c6eed tempest-CreateVolumesFromImageTest-1475985592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:26 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:55:26 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:26 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-42077977-f1a1-4aea-98ed-1b1acf2c6eed tempest-CreateVolumesFromImageTest-1475985592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.277s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:26 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-42077977-f1a1-4aea-98ed-1b1acf2c6eed tempest-CreateVolumesFromImageTest-1475985592 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:55:26 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-42077977-f1a1-4aea-98ed-1b1acf2c6eed tempest-CreateVolumesFromImageTest-1475985592 None] Deleted volume successfully. Sep 16 17:55:26 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-42077977-f1a1-4aea-98ed-1b1acf2c6eed tempest-CreateVolumesFromImageTest-1475985592 None] Lock "cinder-923706e3-847d-4a4c-890b-4f1b8d8c6198-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Flow 'volume_create_manager' (ebdbd882-9dc1-46a4-9cb2-afa4674443c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c55913-1717-407c-ab68-c0dd973aba8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c55913-1717-407c-ab68-c0dd973aba8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-30428910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f639858c-8c4c-4921-894c-c8627e79f6c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440b323da13140babba85dfb0550058d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:29Z,use_quota=True,user_id='a653466ff8954291b22715fad2980707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13f2d76-e81f-4329-99b0-471e61dd2454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13f2d76-e81f-4329-99b0-471e61dd2454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dbcd7bb-f4aa-4ed9-91b2-daa0eff73a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dbcd7bb-f4aa-4ed9-91b2-daa0eff73a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f639858c-8c4c-4921-894c-c8627e79f6c7', 'volume_name': 'volume-f639858c-8c4c-4921-894c-c8627e79f6c7', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da908ee0-202a-45ae-a51e-a361629c7a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da908ee0-202a-45ae-a51e-a361629c7a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae97aafe-ab14-49e2-a39c-f6723dd96565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:29 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Volume f639858c-8c4c-4921-894c-c8627e79f6c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f639858c-8c4c-4921-894c-c8627e79f6c7', 'volume_size': 1} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-30428910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f639858c-8c4c-4921-894c-c8627e79f6c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440b323da13140babba85dfb0550058d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:29Z,use_quota=True,user_id='a653466ff8954291b22715fad2980707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Creating volume f639858c-8c4c-4921-894c-c8627e79f6c7 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:55:29 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:29 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7 1073741824 Sep 16 17:55:29 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:29 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7 1073741824" returned: 0 in 0.401s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:29 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7 Sep 16 17:55:29 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:29 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7" returned: 0 in 0.239s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae97aafe-ab14-49e2-a39c-f6723dd96565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f639858c-8c4c-4921-894c-c8627e79f6c7', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363384a3-c6ca-4bd3-9183-5845bb90d47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:29 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Volume volume-f639858c-8c4c-4921-894c-c8627e79f6c7 (f639858c-8c4c-4921-894c-c8627e79f6c7): created successfully Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363384a3-c6ca-4bd3-9183-5845bb90d47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Flow 'volume_create_manager' (ebdbd882-9dc1-46a4-9cb2-afa4674443c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:29 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-cc8e47ae-27f6-474d-a539-b78fbf6df688 tempest-CreateVolumesFromSnapshotTest-759129938 None] Created volume successfully. Sep 16 17:55:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1de7eb8d-7d65-4426-b93e-c210dbd6e637 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1de7eb8d-7d65-4426-b93e-c210dbd6e637 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-1de7eb8d-7d65-4426-b93e-c210dbd6e637 tempest-CreateVolumesFromSnapshotTest-759129938 None] Creating offline snapshot acdda1ce-25e9-4fb4-b781-a13fcc507b30 of volume f639858c-8c4c-4921-894c-c8627e79f6c7 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:55:30 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ec0c04-cfe8-42c8-aed9-10b6c661ddb9]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:55:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1de7eb8d-7d65-4426-b93e-c210dbd6e637 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:30 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7 Sep 16 17:55:30 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:30 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1de7eb8d-7d65-4426-b93e-c210dbd6e637 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7" returned: 0 in 0.358s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1de7eb8d-7d65-4426-b93e-c210dbd6e637 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.acdda1ce-25e9-4fb4-b781-a13fcc507b30 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:30 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.acdda1ce-25e9-4fb4-b781-a13fcc507b30 1G Sep 16 17:55:30 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:31 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1de7eb8d-7d65-4426-b93e-c210dbd6e637 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.acdda1ce-25e9-4fb4-b781-a13fcc507b30 1G" returned: 0 in 0.382s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1de7eb8d-7d65-4426-b93e-c210dbd6e637 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f639858c-8c4c-4921-894c-c8627e79f6c7 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.acdda1ce-25e9-4fb4-b781-a13fcc507b30 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:31 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f639858c-8c4c-4921-894c-c8627e79f6c7 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.acdda1ce-25e9-4fb4-b781-a13fcc507b30 Sep 16 17:55:31 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:31 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1de7eb8d-7d65-4426-b93e-c210dbd6e637 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f639858c-8c4c-4921-894c-c8627e79f6c7 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.acdda1ce-25e9-4fb4-b781-a13fcc507b30" returned: 0 in 0.278s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:31 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-1de7eb8d-7d65-4426-b93e-c210dbd6e637 tempest-CreateVolumesFromSnapshotTest-759129938 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.acdda1ce-25e9-4fb4-b781-a13fcc507b30 is being set with open permissions: ugo+rw Sep 16 17:55:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1de7eb8d-7d65-4426-b93e-c210dbd6e637 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.acdda1ce-25e9-4fb4-b781-a13fcc507b30 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:31 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.acdda1ce-25e9-4fb4-b781-a13fcc507b30 Sep 16 17:55:31 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:31 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1de7eb8d-7d65-4426-b93e-c210dbd6e637 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.acdda1ce-25e9-4fb4-b781-a13fcc507b30" returned: 0 in 0.238s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1de7eb8d-7d65-4426-b93e-c210dbd6e637 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:31 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.info Sep 16 17:55:31 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:31 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1de7eb8d-7d65-4426-b93e-c210dbd6e637 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.info" returned: 0 in 0.254s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:31 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-1de7eb8d-7d65-4426-b93e-c210dbd6e637 tempest-CreateVolumesFromSnapshotTest-759129938 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.info is being set with open permissions: ugo+rw Sep 16 17:55:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1de7eb8d-7d65-4426-b93e-c210dbd6e637 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:31 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.info Sep 16 17:55:31 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:32 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1de7eb8d-7d65-4426-b93e-c210dbd6e637 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.info" returned: 0 in 0.239s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1de7eb8d-7d65-4426-b93e-c210dbd6e637 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.843s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:32 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-1de7eb8d-7d65-4426-b93e-c210dbd6e637 tempest-CreateVolumesFromSnapshotTest-759129938 None] Create snapshot completed successfully Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Flow 'volume_create_manager' (c59638fc-f7b5-4977-ae05-0626310259c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92b8965-6418-47e3-aad8-d67bbc048cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92b8965-6418-47e3-aad8-d67bbc048cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-658338493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2a88ce-e944-4914-b8d0-c311a75fceae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440b323da13140babba85dfb0550058d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:33Z,use_quota=True,user_id='a653466ff8954291b22715fad2980707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5e2ceb-f295-42c5-a21a-5e0b555a1c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5e2ceb-f295-42c5-a21a-5e0b555a1c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238ddc92-de84-48f2-bfb9-dd27f7564e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238ddc92-de84-48f2-bfb9-dd27f7564e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f2a88ce-e944-4914-b8d0-c311a75fceae', 'volume_name': 'volume-7f2a88ce-e944-4914-b8d0-c311a75fceae', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08060b83-5869-49d3-a101-3bdf0230b02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08060b83-5869-49d3-a101-3bdf0230b02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe81ac6-398c-454c-a1a1-f2b6bcca6f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:32 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Volume 7f2a88ce-e944-4914-b8d0-c311a75fceae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f2a88ce-e944-4914-b8d0-c311a75fceae', 'volume_size': 1} Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-658338493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2a88ce-e944-4914-b8d0-c311a75fceae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440b323da13140babba85dfb0550058d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:33Z,use_quota=True,user_id='a653466ff8954291b22715fad2980707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Creating volume 7f2a88ce-e944-4914-b8d0-c311a75fceae {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:55:32 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:55:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7f2a88ce-e944-4914-b8d0-c311a75fceae 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:32 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7f2a88ce-e944-4914-b8d0-c311a75fceae 1073741824 Sep 16 17:55:32 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Flow 'volume_create_manager' (ae27f44b-8a57-4b2f-9659-b650be967760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8591f758-5e41-48ba-918f-1adb8a16b3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8591f758-5e41-48ba-918f-1adb8a16b3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-443276150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c477338-5a65-4808-a5a3-61834e012364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440b323da13140babba85dfb0550058d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:33Z,use_quota=True,user_id='a653466ff8954291b22715fad2980707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9050c4-3f4e-41f7-b9a7-675dab901d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9050c4-3f4e-41f7-b9a7-675dab901d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04036cf1-a19c-4f57-b53c-e1d35cb9cc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04036cf1-a19c-4f57-b53c-e1d35cb9cc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c477338-5a65-4808-a5a3-61834e012364', 'volume_name': 'volume-4c477338-5a65-4808-a5a3-61834e012364', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e6bb1b-2d1f-45f0-bcf9-0774adbdf011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e6bb1b-2d1f-45f0-bcf9-0774adbdf011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca71748-c48b-4fba-bab6-609c814df903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:33 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Volume 4c477338-5a65-4808-a5a3-61834e012364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c477338-5a65-4808-a5a3-61834e012364', 'volume_size': 1} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:33 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7f2a88ce-e944-4914-b8d0-c311a75fceae 1073741824" returned: 0 in 0.510s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7f2a88ce-e944-4914-b8d0-c311a75fceae {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:33 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7f2a88ce-e944-4914-b8d0-c311a75fceae Sep 16 17:55:33 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Flow 'volume_create_manager' (d022bc94-890f-4b63-8464-1e32ce04b5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e06078-41e6-47f4-a012-8f3ad07e5f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e06078-41e6-47f4-a012-8f3ad07e5f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1398355328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df19fd1-4813-487c-b878-c84320eb93a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440b323da13140babba85dfb0550058d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:33Z,use_quota=True,user_id='a653466ff8954291b22715fad2980707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e0ebf5-e294-4be9-9c99-5ecb8659caca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e0ebf5-e294-4be9-9c99-5ecb8659caca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd019036-e7ea-437c-89ad-04f7fffcd6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd019036-e7ea-437c-89ad-04f7fffcd6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1df19fd1-4813-487c-b878-c84320eb93a3', 'volume_name': 'volume-1df19fd1-4813-487c-b878-c84320eb93a3', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (575cdd99-3f66-4344-b931-ef2028efe8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (575cdd99-3f66-4344-b931-ef2028efe8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294d3056-261f-4df1-958b-913ff0833d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:33 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Volume 1df19fd1-4813-487c-b878-c84320eb93a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1df19fd1-4813-487c-b878-c84320eb93a3', 'volume_size': 1} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:33 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7f2a88ce-e944-4914-b8d0-c311a75fceae" returned: 0 in 0.283s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.471s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-443276150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c477338-5a65-4808-a5a3-61834e012364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440b323da13140babba85dfb0550058d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:33Z,use_quota=True,user_id='a653466ff8954291b22715fad2980707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Creating volume 4c477338-5a65-4808-a5a3-61834e012364 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:33 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c477338-5a65-4808-a5a3-61834e012364 1073741824 Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:55:33 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c477338-5a65-4808-a5a3-61834e012364 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe81ac6-398c-454c-a1a1-f2b6bcca6f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f2a88ce-e944-4914-b8d0-c311a75fceae', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:33 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81f2935-624a-4556-8007-6ba15ee07120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:33 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Volume volume-7f2a88ce-e944-4914-b8d0-c311a75fceae (7f2a88ce-e944-4914-b8d0-c311a75fceae): created successfully Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81f2935-624a-4556-8007-6ba15ee07120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Flow 'volume_create_manager' (c59638fc-f7b5-4977-ae05-0626310259c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:33 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-f35d609b-52fe-4278-8a61-77a87c89f9ab tempest-CreateVolumesFromSnapshotTest-759129938 None] Created volume successfully. Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Flow 'volume_create_manager' (d9fdd506-a432-405c-9d3d-122a62f51edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689a3695-457e-426d-b16c-a0ac84ee38ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689a3695-457e-426d-b16c-a0ac84ee38ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-740335403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e72cdf-99f9-4c09-a1d7-b7e913c2f067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440b323da13140babba85dfb0550058d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:34Z,use_quota=True,user_id='a653466ff8954291b22715fad2980707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f7c4f3-48e3-4d75-8ec4-cc645764f418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f7c4f3-48e3-4d75-8ec4-cc645764f418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38215546-81db-4704-b78c-c36b92cc7cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38215546-81db-4704-b78c-c36b92cc7cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53e72cdf-99f9-4c09-a1d7-b7e913c2f067', 'volume_name': 'volume-53e72cdf-99f9-4c09-a1d7-b7e913c2f067', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a331ffc8-7b7a-42be-8867-8f928771f06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a331ffc8-7b7a-42be-8867-8f928771f06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17694c6f-a821-42b8-abad-5e830bfb8c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:34 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Volume 53e72cdf-99f9-4c09-a1d7-b7e913c2f067: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53e72cdf-99f9-4c09-a1d7-b7e913c2f067', 'volume_size': 1} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:55:34 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Flow 'volume_create_manager' (dda83fcc-ab17-4ad3-b8b9-ca253449716a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1733be11-aa44-4337-b11a-c3f1be85faf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c477338-5a65-4808-a5a3-61834e012364 1073741824" returned: 0 in 0.551s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1733be11-aa44-4337-b11a-c3f1be85faf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1985447996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4125be6d-de24-47ad-9d88-64de2d9af706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440b323da13140babba85dfb0550058d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:34Z,use_quota=True,user_id='a653466ff8954291b22715fad2980707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6c8bfc-738d-43a6-9db8-95f97a23c347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6c8bfc-738d-43a6-9db8-95f97a23c347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c8c698-2368-4a37-b530-1469d169e663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c8c698-2368-4a37-b530-1469d169e663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4125be6d-de24-47ad-9d88-64de2d9af706', 'volume_name': 'volume-4125be6d-de24-47ad-9d88-64de2d9af706', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047afce2-fbf1-4219-aeae-437d5a96afbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047afce2-fbf1-4219-aeae-437d5a96afbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d3b33c-d799-48b0-a518-6287f0884f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:34 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Volume 4125be6d-de24-47ad-9d88-64de2d9af706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4125be6d-de24-47ad-9d88-64de2d9af706', 'volume_size': 1} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c477338-5a65-4808-a5a3-61834e012364 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:34 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c477338-5a65-4808-a5a3-61834e012364 Sep 16 17:55:34 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:34 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c477338-5a65-4808-a5a3-61834e012364" returned: 0 in 0.257s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.045s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1398355328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df19fd1-4813-487c-b878-c84320eb93a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440b323da13140babba85dfb0550058d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:33Z,use_quota=True,user_id='a653466ff8954291b22715fad2980707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Creating volume 1df19fd1-4813-487c-b878-c84320eb93a3 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:55:34 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1df19fd1-4813-487c-b878-c84320eb93a3 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:34 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1df19fd1-4813-487c-b878-c84320eb93a3 1073741824 Sep 16 17:55:34 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca71748-c48b-4fba-bab6-609c814df903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c477338-5a65-4808-a5a3-61834e012364', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33cb3721-738b-44bb-8870-a32e296d8a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:34 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Volume volume-4c477338-5a65-4808-a5a3-61834e012364 (4c477338-5a65-4808-a5a3-61834e012364): created successfully Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33cb3721-738b-44bb-8870-a32e296d8a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Flow 'volume_create_manager' (ae27f44b-8a57-4b2f-9659-b650be967760) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:34 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-05ab21fa-7a28-48e4-8496-5fdf32bb87b9 tempest-CreateVolumesFromSnapshotTest-759129938 None] Created volume successfully. Sep 16 17:55:35 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1df19fd1-4813-487c-b878-c84320eb93a3 1073741824" returned: 0 in 0.406s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1df19fd1-4813-487c-b878-c84320eb93a3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:35 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1df19fd1-4813-487c-b878-c84320eb93a3 Sep 16 17:55:35 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:35 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1df19fd1-4813-487c-b878-c84320eb93a3" returned: 0 in 0.250s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:55:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.304s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-740335403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e72cdf-99f9-4c09-a1d7-b7e913c2f067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440b323da13140babba85dfb0550058d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:34Z,use_quota=True,user_id='a653466ff8954291b22715fad2980707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:55:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Creating volume 53e72cdf-99f9-4c09-a1d7-b7e913c2f067 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:55:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:55:35 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:55:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53e72cdf-99f9-4c09-a1d7-b7e913c2f067 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294d3056-261f-4df1-958b-913ff0833d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1df19fd1-4813-487c-b878-c84320eb93a3', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:35 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53e72cdf-99f9-4c09-a1d7-b7e913c2f067 1073741824 Sep 16 17:55:35 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5aae273-dc65-4c72-aac1-706c98546588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:35 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Volume volume-1df19fd1-4813-487c-b878-c84320eb93a3 (1df19fd1-4813-487c-b878-c84320eb93a3): created successfully Sep 16 17:55:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5aae273-dc65-4c72-aac1-706c98546588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Flow 'volume_create_manager' (d022bc94-890f-4b63-8464-1e32ce04b5d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:35 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-3005f388-6cdd-46af-a016-84a2774c8723 tempest-CreateVolumesFromSnapshotTest-759129938 None] Created volume successfully. Sep 16 17:55:35 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53e72cdf-99f9-4c09-a1d7-b7e913c2f067 1073741824" returned: 0 in 0.413s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53e72cdf-99f9-4c09-a1d7-b7e913c2f067 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:35 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53e72cdf-99f9-4c09-a1d7-b7e913c2f067 Sep 16 17:55:35 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:36 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53e72cdf-99f9-4c09-a1d7-b7e913c2f067" returned: 0 in 0.231s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.672s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1985447996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4125be6d-de24-47ad-9d88-64de2d9af706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440b323da13140babba85dfb0550058d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:34Z,use_quota=True,user_id='a653466ff8954291b22715fad2980707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Creating volume 4125be6d-de24-47ad-9d88-64de2d9af706 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:55:36 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4125be6d-de24-47ad-9d88-64de2d9af706 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17694c6f-a821-42b8-abad-5e830bfb8c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53e72cdf-99f9-4c09-a1d7-b7e913c2f067', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:36 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4125be6d-de24-47ad-9d88-64de2d9af706 1073741824 Sep 16 17:55:36 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b513222-feb6-4fd1-8b83-905adaf97aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:36 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Volume volume-53e72cdf-99f9-4c09-a1d7-b7e913c2f067 (53e72cdf-99f9-4c09-a1d7-b7e913c2f067): created successfully Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b513222-feb6-4fd1-8b83-905adaf97aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Flow 'volume_create_manager' (d9fdd506-a432-405c-9d3d-122a62f51edd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:36 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-b5295c8f-dd98-4e66-9fc7-6d360b92ef82 tempest-CreateVolumesFromSnapshotTest-759129938 None] Created volume successfully. Sep 16 17:55:36 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4125be6d-de24-47ad-9d88-64de2d9af706 1073741824" returned: 0 in 0.416s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4125be6d-de24-47ad-9d88-64de2d9af706 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:36 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4125be6d-de24-47ad-9d88-64de2d9af706 Sep 16 17:55:36 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:36 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4125be6d-de24-47ad-9d88-64de2d9af706" returned: 0 in 0.243s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d3b33c-d799-48b0-a518-6287f0884f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4125be6d-de24-47ad-9d88-64de2d9af706', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7633a38d-fe66-47a2-b0a4-f4324ff22725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:36 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Volume volume-4125be6d-de24-47ad-9d88-64de2d9af706 (4125be6d-de24-47ad-9d88-64de2d9af706): created successfully Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7633a38d-fe66-47a2-b0a4-f4324ff22725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Flow 'volume_create_manager' (dda83fcc-ab17-4ad3-b8b9-ca253449716a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:36 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-b2f3ac88-1f6e-43f2-a137-af08472d9d0b tempest-CreateVolumesFromSnapshotTest-759129938 None] Created volume successfully. Sep 16 17:55:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79b65192-747d-4a33-b465-6faf2e1a9a3c tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "cinder-4125be6d-de24-47ad-9d88-64de2d9af706-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79b65192-747d-4a33-b465-6faf2e1a9a3c tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-4125be6d-de24-47ad-9d88-64de2d9af706-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79b65192-747d-4a33-b465-6faf2e1a9a3c tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "cinder-quobyte-4125be6d-de24-47ad-9d88-64de2d9af706" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79b65192-747d-4a33-b465-6faf2e1a9a3c tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-quobyte-4125be6d-de24-47ad-9d88-64de2d9af706" acquired by "delete_volume" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:37 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb011cd-aa7b-486e-883d-74db9e91f784]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:55:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79b65192-747d-4a33-b465-6faf2e1a9a3c tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4125be6d-de24-47ad-9d88-64de2d9af706 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:37 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4125be6d-de24-47ad-9d88-64de2d9af706 Sep 16 17:55:37 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:38 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79b65192-747d-4a33-b465-6faf2e1a9a3c tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4125be6d-de24-47ad-9d88-64de2d9af706" returned: 0 in 0.345s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79b65192-747d-4a33-b465-6faf2e1a9a3c tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4125be6d-de24-47ad-9d88-64de2d9af706 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:38 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4125be6d-de24-47ad-9d88-64de2d9af706 Sep 16 17:55:38 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:38 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79b65192-747d-4a33-b465-6faf2e1a9a3c tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4125be6d-de24-47ad-9d88-64de2d9af706" returned: 0 in 0.239s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79b65192-747d-4a33-b465-6faf2e1a9a3c tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-quobyte-4125be6d-de24-47ad-9d88-64de2d9af706" released by "delete_volume" :: held 0.624s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:38 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-79b65192-747d-4a33-b465-6faf2e1a9a3c tempest-CreateVolumesFromSnapshotTest-759129938 None] Created reservations ['3de594c8-668d-4a2f-a85b-ca952479d11a', 'e03de021-07ff-4707-9bca-718aaa4cb140', '48a31eae-a8ee-478f-8104-1565f78935fe', '3bf2e32f-b6ab-42eb-9b00-0efd6f6c297b'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:55:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-79b65192-747d-4a33-b465-6faf2e1a9a3c tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-79b65192-747d-4a33-b465-6faf2e1a9a3c tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-79b65192-747d-4a33-b465-6faf2e1a9a3c tempest-CreateVolumesFromSnapshotTest-759129938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-79b65192-747d-4a33-b465-6faf2e1a9a3c tempest-CreateVolumesFromSnapshotTest-759129938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-79b65192-747d-4a33-b465-6faf2e1a9a3c tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79b65192-747d-4a33-b465-6faf2e1a9a3c tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:38 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:55:38 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:38 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-79b65192-747d-4a33-b465-6faf2e1a9a3c tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.234s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:38 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-79b65192-747d-4a33-b465-6faf2e1a9a3c tempest-CreateVolumesFromSnapshotTest-759129938 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:55:38 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-79b65192-747d-4a33-b465-6faf2e1a9a3c tempest-CreateVolumesFromSnapshotTest-759129938 None] Deleted volume successfully. Sep 16 17:55:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-79b65192-747d-4a33-b465-6faf2e1a9a3c tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-4125be6d-de24-47ad-9d88-64de2d9af706-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e4f701aa-73ca-4d5f-a77e-19740fe1f3d8 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "cinder-53e72cdf-99f9-4c09-a1d7-b7e913c2f067-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e4f701aa-73ca-4d5f-a77e-19740fe1f3d8 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-53e72cdf-99f9-4c09-a1d7-b7e913c2f067-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e4f701aa-73ca-4d5f-a77e-19740fe1f3d8 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "cinder-quobyte-53e72cdf-99f9-4c09-a1d7-b7e913c2f067" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e4f701aa-73ca-4d5f-a77e-19740fe1f3d8 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-quobyte-53e72cdf-99f9-4c09-a1d7-b7e913c2f067" acquired by "delete_volume" :: waited 0.015s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:38 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fee9cd-abd6-40e9-96fb-f356bdc1dc21]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:55:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e4f701aa-73ca-4d5f-a77e-19740fe1f3d8 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53e72cdf-99f9-4c09-a1d7-b7e913c2f067 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:38 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53e72cdf-99f9-4c09-a1d7-b7e913c2f067 Sep 16 17:55:38 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:39 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e4f701aa-73ca-4d5f-a77e-19740fe1f3d8 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53e72cdf-99f9-4c09-a1d7-b7e913c2f067" returned: 0 in 0.352s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e4f701aa-73ca-4d5f-a77e-19740fe1f3d8 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53e72cdf-99f9-4c09-a1d7-b7e913c2f067 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:39 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53e72cdf-99f9-4c09-a1d7-b7e913c2f067 Sep 16 17:55:39 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:39 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e4f701aa-73ca-4d5f-a77e-19740fe1f3d8 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-53e72cdf-99f9-4c09-a1d7-b7e913c2f067" returned: 0 in 0.258s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e4f701aa-73ca-4d5f-a77e-19740fe1f3d8 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-quobyte-53e72cdf-99f9-4c09-a1d7-b7e913c2f067" released by "delete_volume" :: held 0.651s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:39 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-e4f701aa-73ca-4d5f-a77e-19740fe1f3d8 tempest-CreateVolumesFromSnapshotTest-759129938 None] Created reservations ['32198b4e-315e-4f14-9966-2c4a0e6583bc', '096f8518-627d-401b-89ed-a46ae2db3cec', '4ea82d5a-fad5-4c37-9ea8-9e466e22ae2c', '02908d98-19a0-43a7-94f0-2153a46f70ed'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:55:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e4f701aa-73ca-4d5f-a77e-19740fe1f3d8 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e4f701aa-73ca-4d5f-a77e-19740fe1f3d8 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e4f701aa-73ca-4d5f-a77e-19740fe1f3d8 tempest-CreateVolumesFromSnapshotTest-759129938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e4f701aa-73ca-4d5f-a77e-19740fe1f3d8 tempest-CreateVolumesFromSnapshotTest-759129938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e4f701aa-73ca-4d5f-a77e-19740fe1f3d8 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e4f701aa-73ca-4d5f-a77e-19740fe1f3d8 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:39 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:55:39 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:39 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e4f701aa-73ca-4d5f-a77e-19740fe1f3d8 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.237s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:39 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-e4f701aa-73ca-4d5f-a77e-19740fe1f3d8 tempest-CreateVolumesFromSnapshotTest-759129938 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:55:39 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-e4f701aa-73ca-4d5f-a77e-19740fe1f3d8 tempest-CreateVolumesFromSnapshotTest-759129938 None] Deleted volume successfully. Sep 16 17:55:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e4f701aa-73ca-4d5f-a77e-19740fe1f3d8 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-53e72cdf-99f9-4c09-a1d7-b7e913c2f067-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-967fb880-5ab6-4e32-a2ed-c080d6a6e462 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "cinder-1df19fd1-4813-487c-b878-c84320eb93a3-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-967fb880-5ab6-4e32-a2ed-c080d6a6e462 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-1df19fd1-4813-487c-b878-c84320eb93a3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-967fb880-5ab6-4e32-a2ed-c080d6a6e462 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "cinder-quobyte-1df19fd1-4813-487c-b878-c84320eb93a3" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:40 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-967fb880-5ab6-4e32-a2ed-c080d6a6e462 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-quobyte-1df19fd1-4813-487c-b878-c84320eb93a3" acquired by "delete_volume" :: waited 0.014s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:40 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3d7c42-fdf1-4887-9b35-0cc8c457cee7]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:55:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-967fb880-5ab6-4e32-a2ed-c080d6a6e462 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1df19fd1-4813-487c-b878-c84320eb93a3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:40 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1df19fd1-4813-487c-b878-c84320eb93a3 Sep 16 17:55:40 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:40 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-967fb880-5ab6-4e32-a2ed-c080d6a6e462 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1df19fd1-4813-487c-b878-c84320eb93a3" returned: 0 in 0.349s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-967fb880-5ab6-4e32-a2ed-c080d6a6e462 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1df19fd1-4813-487c-b878-c84320eb93a3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:40 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1df19fd1-4813-487c-b878-c84320eb93a3 Sep 16 17:55:40 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:40 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-967fb880-5ab6-4e32-a2ed-c080d6a6e462 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1df19fd1-4813-487c-b878-c84320eb93a3" returned: 0 in 0.237s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:40 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-967fb880-5ab6-4e32-a2ed-c080d6a6e462 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-quobyte-1df19fd1-4813-487c-b878-c84320eb93a3" released by "delete_volume" :: held 0.626s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:40 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-967fb880-5ab6-4e32-a2ed-c080d6a6e462 tempest-CreateVolumesFromSnapshotTest-759129938 None] Created reservations ['f3980d78-3f42-478b-8278-b73e68ec9c78', 'd2ffcf0d-077f-4d67-ba60-72523958a77d', 'b714419d-ccec-4158-a004-3ce1f62f4dea', '7d670344-2ac6-4914-86cf-ca7100c530c7'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:55:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-967fb880-5ab6-4e32-a2ed-c080d6a6e462 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-967fb880-5ab6-4e32-a2ed-c080d6a6e462 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-967fb880-5ab6-4e32-a2ed-c080d6a6e462 tempest-CreateVolumesFromSnapshotTest-759129938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-967fb880-5ab6-4e32-a2ed-c080d6a6e462 tempest-CreateVolumesFromSnapshotTest-759129938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-967fb880-5ab6-4e32-a2ed-c080d6a6e462 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-967fb880-5ab6-4e32-a2ed-c080d6a6e462 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:40 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:55:40 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:40 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-967fb880-5ab6-4e32-a2ed-c080d6a6e462 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.250s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:41 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-967fb880-5ab6-4e32-a2ed-c080d6a6e462 tempest-CreateVolumesFromSnapshotTest-759129938 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:55:41 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-967fb880-5ab6-4e32-a2ed-c080d6a6e462 tempest-CreateVolumesFromSnapshotTest-759129938 None] Deleted volume successfully. Sep 16 17:55:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-967fb880-5ab6-4e32-a2ed-c080d6a6e462 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-1df19fd1-4813-487c-b878-c84320eb93a3-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-018e3a5f-aff5-4cee-9312-d1ef59ba9640 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "cinder-4c477338-5a65-4808-a5a3-61834e012364-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-018e3a5f-aff5-4cee-9312-d1ef59ba9640 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-4c477338-5a65-4808-a5a3-61834e012364-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-018e3a5f-aff5-4cee-9312-d1ef59ba9640 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "cinder-quobyte-4c477338-5a65-4808-a5a3-61834e012364" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-018e3a5f-aff5-4cee-9312-d1ef59ba9640 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-quobyte-4c477338-5a65-4808-a5a3-61834e012364" acquired by "delete_volume" :: waited 0.013s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:41 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac45762-e41c-424a-ad2b-035acb7609c0]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:55:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-018e3a5f-aff5-4cee-9312-d1ef59ba9640 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c477338-5a65-4808-a5a3-61834e012364 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:41 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c477338-5a65-4808-a5a3-61834e012364 Sep 16 17:55:41 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:41 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-018e3a5f-aff5-4cee-9312-d1ef59ba9640 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c477338-5a65-4808-a5a3-61834e012364" returned: 0 in 0.359s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-018e3a5f-aff5-4cee-9312-d1ef59ba9640 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c477338-5a65-4808-a5a3-61834e012364 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:41 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c477338-5a65-4808-a5a3-61834e012364 Sep 16 17:55:41 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:41 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-018e3a5f-aff5-4cee-9312-d1ef59ba9640 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-4c477338-5a65-4808-a5a3-61834e012364" returned: 0 in 0.244s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-018e3a5f-aff5-4cee-9312-d1ef59ba9640 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-quobyte-4c477338-5a65-4808-a5a3-61834e012364" released by "delete_volume" :: held 0.641s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:41 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-018e3a5f-aff5-4cee-9312-d1ef59ba9640 tempest-CreateVolumesFromSnapshotTest-759129938 None] Created reservations ['918c36cb-3e4b-4169-95f8-1ea437c20700', '25ce53d0-a072-4502-bfea-98a729be2589', '10685308-62ca-4af7-adf8-bd976a1037b6', '298f6c91-3825-4ac0-8882-94b343251946'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:55:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-018e3a5f-aff5-4cee-9312-d1ef59ba9640 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-018e3a5f-aff5-4cee-9312-d1ef59ba9640 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:41 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-018e3a5f-aff5-4cee-9312-d1ef59ba9640 tempest-CreateVolumesFromSnapshotTest-759129938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:41 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-018e3a5f-aff5-4cee-9312-d1ef59ba9640 tempest-CreateVolumesFromSnapshotTest-759129938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-018e3a5f-aff5-4cee-9312-d1ef59ba9640 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-018e3a5f-aff5-4cee-9312-d1ef59ba9640 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:41 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:55:41 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:42 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-018e3a5f-aff5-4cee-9312-d1ef59ba9640 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.237s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:42 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-018e3a5f-aff5-4cee-9312-d1ef59ba9640 tempest-CreateVolumesFromSnapshotTest-759129938 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:55:42 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-018e3a5f-aff5-4cee-9312-d1ef59ba9640 tempest-CreateVolumesFromSnapshotTest-759129938 None] Deleted volume successfully. Sep 16 17:55:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-018e3a5f-aff5-4cee-9312-d1ef59ba9640 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-4c477338-5a65-4808-a5a3-61834e012364-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e2e00d33-86fd-4211-aa4c-a927b530384a tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "cinder-7f2a88ce-e944-4914-b8d0-c311a75fceae-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e2e00d33-86fd-4211-aa4c-a927b530384a tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-7f2a88ce-e944-4914-b8d0-c311a75fceae-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e2e00d33-86fd-4211-aa4c-a927b530384a tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "cinder-quobyte-7f2a88ce-e944-4914-b8d0-c311a75fceae" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e2e00d33-86fd-4211-aa4c-a927b530384a tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-quobyte-7f2a88ce-e944-4914-b8d0-c311a75fceae" acquired by "delete_volume" :: waited 0.013s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:42 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d604a8-696d-40cb-ac64-69adb5e9f3e9]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:55:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e2e00d33-86fd-4211-aa4c-a927b530384a tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7f2a88ce-e944-4914-b8d0-c311a75fceae {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:42 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7f2a88ce-e944-4914-b8d0-c311a75fceae Sep 16 17:55:42 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:42 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e2e00d33-86fd-4211-aa4c-a927b530384a tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7f2a88ce-e944-4914-b8d0-c311a75fceae" returned: 0 in 0.354s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e2e00d33-86fd-4211-aa4c-a927b530384a tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7f2a88ce-e944-4914-b8d0-c311a75fceae {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:42 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7f2a88ce-e944-4914-b8d0-c311a75fceae Sep 16 17:55:42 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:42 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e2e00d33-86fd-4211-aa4c-a927b530384a tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7f2a88ce-e944-4914-b8d0-c311a75fceae" returned: 0 in 0.235s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e2e00d33-86fd-4211-aa4c-a927b530384a tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-quobyte-7f2a88ce-e944-4914-b8d0-c311a75fceae" released by "delete_volume" :: held 0.627s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:42 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-e2e00d33-86fd-4211-aa4c-a927b530384a tempest-CreateVolumesFromSnapshotTest-759129938 None] Created reservations ['b3abd409-4c50-4330-beb0-39c7decf14a9', 'aae7fbeb-e363-4315-a860-f756276ff393', '8aa4a4f5-c678-486f-ae8c-c68576d115cb', '9b174f9a-6074-497d-8902-565593bc8cf1'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:55:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e2e00d33-86fd-4211-aa4c-a927b530384a tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e2e00d33-86fd-4211-aa4c-a927b530384a tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e2e00d33-86fd-4211-aa4c-a927b530384a tempest-CreateVolumesFromSnapshotTest-759129938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e2e00d33-86fd-4211-aa4c-a927b530384a tempest-CreateVolumesFromSnapshotTest-759129938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e2e00d33-86fd-4211-aa4c-a927b530384a tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e2e00d33-86fd-4211-aa4c-a927b530384a tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:43 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:55:43 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:43 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e2e00d33-86fd-4211-aa4c-a927b530384a tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.240s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:43 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-e2e00d33-86fd-4211-aa4c-a927b530384a tempest-CreateVolumesFromSnapshotTest-759129938 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:55:43 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-e2e00d33-86fd-4211-aa4c-a927b530384a tempest-CreateVolumesFromSnapshotTest-759129938 None] Deleted volume successfully. Sep 16 17:55:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e2e00d33-86fd-4211-aa4c-a927b530384a tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-7f2a88ce-e944-4914-b8d0-c311a75fceae-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-de1a7a75-6f33-4d8b-afcf-e6996854d5e1 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "cinder-acdda1ce-25e9-4fb4-b781-a13fcc507b30-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-de1a7a75-6f33-4d8b-afcf-e6996854d5e1 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-acdda1ce-25e9-4fb4-b781-a13fcc507b30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-de1a7a75-6f33-4d8b-afcf-e6996854d5e1 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "cinder-quobyte-f639858c-8c4c-4921-894c-c8627e79f6c7" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-de1a7a75-6f33-4d8b-afcf-e6996854d5e1 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-quobyte-f639858c-8c4c-4921-894c-c8627e79f6c7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-de1a7a75-6f33-4d8b-afcf-e6996854d5e1 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "cinder-quobyte-acdda1ce-25e9-4fb4-b781-a13fcc507b30" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-de1a7a75-6f33-4d8b-afcf-e6996854d5e1 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-quobyte-acdda1ce-25e9-4fb4-b781-a13fcc507b30" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-de1a7a75-6f33-4d8b-afcf-e6996854d5e1 tempest-CreateVolumesFromSnapshotTest-759129938 None] Deleting offline snapshot acdda1ce-25e9-4fb4-b781-a13fcc507b30 of volume f639858c-8c4c-4921-894c-c8627e79f6c7 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:55:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-de1a7a75-6f33-4d8b-afcf-e6996854d5e1 tempest-CreateVolumesFromSnapshotTest-759129938 None] snapshot_file for this snap is: volume-f639858c-8c4c-4921-894c-c8627e79f6c7.acdda1ce-25e9-4fb4-b781-a13fcc507b30 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:55:43 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dc98ae-fee8-4f85-ab80-6ccbb67ed463]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:55:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-de1a7a75-6f33-4d8b-afcf-e6996854d5e1 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.acdda1ce-25e9-4fb4-b781-a13fcc507b30 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:43 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.acdda1ce-25e9-4fb4-b781-a13fcc507b30 Sep 16 17:55:43 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:43 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-de1a7a75-6f33-4d8b-afcf-e6996854d5e1 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.acdda1ce-25e9-4fb4-b781-a13fcc507b30" returned: 0 in 0.346s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-de1a7a75-6f33-4d8b-afcf-e6996854d5e1 tempest-CreateVolumesFromSnapshotTest-759129938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f639858c-8c4c-4921-894c-c8627e79f6c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:55:43 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a3c59b-9a07-4da8-b057-8cdf23d9b3ce]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:55:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-de1a7a75-6f33-4d8b-afcf-e6996854d5e1 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:43 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7 Sep 16 17:55:43 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:44 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-de1a7a75-6f33-4d8b-afcf-e6996854d5e1 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7" returned: 0 in 0.340s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-de1a7a75-6f33-4d8b-afcf-e6996854d5e1 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.acdda1ce-25e9-4fb4-b781-a13fcc507b30 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:44 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.acdda1ce-25e9-4fb4-b781-a13fcc507b30 Sep 16 17:55:44 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:44 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-de1a7a75-6f33-4d8b-afcf-e6996854d5e1 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.acdda1ce-25e9-4fb4-b781-a13fcc507b30" returned: 0 in 0.345s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-de1a7a75-6f33-4d8b-afcf-e6996854d5e1 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.acdda1ce-25e9-4fb4-b781-a13fcc507b30 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:44 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.acdda1ce-25e9-4fb4-b781-a13fcc507b30 Sep 16 17:55:44 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:44 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-de1a7a75-6f33-4d8b-afcf-e6996854d5e1 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7.acdda1ce-25e9-4fb4-b781-a13fcc507b30" returned: 0 in 0.235s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-de1a7a75-6f33-4d8b-afcf-e6996854d5e1 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-quobyte-acdda1ce-25e9-4fb4-b781-a13fcc507b30" released by "_delete_snapshot" :: held 1.367s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-de1a7a75-6f33-4d8b-afcf-e6996854d5e1 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-quobyte-f639858c-8c4c-4921-894c-c8627e79f6c7" released by "delete_snapshot" :: held 1.389s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:44 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-de1a7a75-6f33-4d8b-afcf-e6996854d5e1 tempest-CreateVolumesFromSnapshotTest-759129938 None] Created reservations ['27609fc7-ccd4-4b1c-a18c-8b12468c3185', '5692c5c7-6625-42ae-8bfb-a39e7904c971', 'eaed2800-6285-487d-9eeb-c256c39b495a', '5a0d62a0-1972-40b0-b4fc-269e73e956b0'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:55:44 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-de1a7a75-6f33-4d8b-afcf-e6996854d5e1 tempest-CreateVolumesFromSnapshotTest-759129938 None] Delete snapshot completed successfully. Sep 16 17:55:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-de1a7a75-6f33-4d8b-afcf-e6996854d5e1 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-acdda1ce-25e9-4fb4-b781-a13fcc507b30-delete_snapshot" released by "delete_snapshot" :: held 1.509s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7b6164d7-416d-4570-9818-d8434f6d1b28 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "cinder-f639858c-8c4c-4921-894c-c8627e79f6c7-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7b6164d7-416d-4570-9818-d8434f6d1b28 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-f639858c-8c4c-4921-894c-c8627e79f6c7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7b6164d7-416d-4570-9818-d8434f6d1b28 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "cinder-quobyte-f639858c-8c4c-4921-894c-c8627e79f6c7" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7b6164d7-416d-4570-9818-d8434f6d1b28 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-quobyte-f639858c-8c4c-4921-894c-c8627e79f6c7" acquired by "delete_volume" :: waited 0.013s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:45 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f095d13c-c137-4674-82ad-eedc78ec2b19]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:55:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7b6164d7-416d-4570-9818-d8434f6d1b28 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:45 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7 Sep 16 17:55:45 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:45 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7b6164d7-416d-4570-9818-d8434f6d1b28 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7" returned: 0 in 0.339s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7b6164d7-416d-4570-9818-d8434f6d1b28 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:46 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7 Sep 16 17:55:46 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:46 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7b6164d7-416d-4570-9818-d8434f6d1b28 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f639858c-8c4c-4921-894c-c8627e79f6c7" returned: 0 in 0.233s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7b6164d7-416d-4570-9818-d8434f6d1b28 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-quobyte-f639858c-8c4c-4921-894c-c8627e79f6c7" released by "delete_volume" :: held 0.629s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:46 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-7b6164d7-416d-4570-9818-d8434f6d1b28 tempest-CreateVolumesFromSnapshotTest-759129938 None] Created reservations ['99d1b4d3-f5f0-47ad-b8ed-cce65b348ea9', 'b056d3d5-7919-453d-b78a-fdce3e09c594', '8c13e98d-ccdf-406b-a3fd-0e84d896ec40', '3974591b-6f5b-46bc-ab4e-fcd64a4d925a'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:55:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7b6164d7-416d-4570-9818-d8434f6d1b28 tempest-CreateVolumesFromSnapshotTest-759129938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7b6164d7-416d-4570-9818-d8434f6d1b28 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7b6164d7-416d-4570-9818-d8434f6d1b28 tempest-CreateVolumesFromSnapshotTest-759129938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7b6164d7-416d-4570-9818-d8434f6d1b28 tempest-CreateVolumesFromSnapshotTest-759129938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7b6164d7-416d-4570-9818-d8434f6d1b28 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7b6164d7-416d-4570-9818-d8434f6d1b28 tempest-CreateVolumesFromSnapshotTest-759129938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:46 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:55:46 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:46 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7b6164d7-416d-4570-9818-d8434f6d1b28 tempest-CreateVolumesFromSnapshotTest-759129938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.229s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:46 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-7b6164d7-416d-4570-9818-d8434f6d1b28 tempest-CreateVolumesFromSnapshotTest-759129938 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:55:46 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-7b6164d7-416d-4570-9818-d8434f6d1b28 tempest-CreateVolumesFromSnapshotTest-759129938 None] Deleted volume successfully. Sep 16 17:55:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7b6164d7-416d-4570-9818-d8434f6d1b28 tempest-CreateVolumesFromSnapshotTest-759129938 None] Lock "cinder-f639858c-8c4c-4921-894c-c8627e79f6c7-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Flow 'volume_create_manager' (304baf42-76cc-440b-a3df-586f47f063a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e4ae1c6-f995-4e35-8b60-92a3da5203c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e4ae1c6-f995-4e35-8b60-92a3da5203c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-719656590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=236e9151-a168-4264-8e40-5ce76713a150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881331d51df44c7986e50f56f29c8ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:49Z,use_quota=True,user_id='284ff3cf7b824d8e9538fd7bc1e9efbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1f4981-2b36-42bc-941f-b1800f430de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1f4981-2b36-42bc-941f-b1800f430de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76dbd6a-660a-4752-8f07-42f6c1a59269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76dbd6a-660a-4752-8f07-42f6c1a59269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '236e9151-a168-4264-8e40-5ce76713a150', 'volume_name': 'volume-236e9151-a168-4264-8e40-5ce76713a150', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28987ad-e10b-4d64-9142-076afbba4bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28987ad-e10b-4d64-9142-076afbba4bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dee2619-7500-480e-915d-01f31a6cd07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:49 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Volume 236e9151-a168-4264-8e40-5ce76713a150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-236e9151-a168-4264-8e40-5ce76713a150', 'volume_size': 1} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-719656590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=236e9151-a168-4264-8e40-5ce76713a150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881331d51df44c7986e50f56f29c8ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:49Z,use_quota=True,user_id='284ff3cf7b824d8e9538fd7bc1e9efbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Creating volume 236e9151-a168-4264-8e40-5ce76713a150 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:55:49 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-236e9151-a168-4264-8e40-5ce76713a150 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:49 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-236e9151-a168-4264-8e40-5ce76713a150 1073741824 Sep 16 17:55:49 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:49 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-236e9151-a168-4264-8e40-5ce76713a150 1073741824" returned: 0 in 0.395s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-236e9151-a168-4264-8e40-5ce76713a150 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:49 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-236e9151-a168-4264-8e40-5ce76713a150 Sep 16 17:55:49 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:49 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-236e9151-a168-4264-8e40-5ce76713a150" returned: 0 in 0.229s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:55:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dee2619-7500-480e-915d-01f31a6cd07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-236e9151-a168-4264-8e40-5ce76713a150', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd844495-95dd-4abe-b0a5-b92e88bb8383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:50 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Volume volume-236e9151-a168-4264-8e40-5ce76713a150 (236e9151-a168-4264-8e40-5ce76713a150): created successfully Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd844495-95dd-4abe-b0a5-b92e88bb8383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Flow 'volume_create_manager' (304baf42-76cc-440b-a3df-586f47f063a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:50 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5257c09a-0730-4a94-8fe0-83f2c7e3e31d tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Created volume successfully. Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Flow 'volume_create_manager' (7a3dcec5-385e-46f1-a94a-019b427040bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2882d7-2e96-4b5c-8f49-3d9cefc33fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2882d7-2e96-4b5c-8f49-3d9cefc33fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1131225686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa120a4-ad83-43bf-b1ce-f30428f887c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881331d51df44c7986e50f56f29c8ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:51Z,use_quota=True,user_id='284ff3cf7b824d8e9538fd7bc1e9efbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418dac04-e233-40e3-abe9-2baae86397d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418dac04-e233-40e3-abe9-2baae86397d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba93fb7-da2b-4e9c-900c-45834d6d6626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba93fb7-da2b-4e9c-900c-45834d6d6626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baa120a4-ad83-43bf-b1ce-f30428f887c8', 'volume_name': 'volume-baa120a4-ad83-43bf-b1ce-f30428f887c8', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (084d8db6-14ab-4dd6-bd1f-1b034a609e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (084d8db6-14ab-4dd6-bd1f-1b034a609e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1f080d-6483-49e8-a76d-affb8ae9cb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:50 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Volume baa120a4-ad83-43bf-b1ce-f30428f887c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baa120a4-ad83-43bf-b1ce-f30428f887c8', 'volume_size': 1} Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1131225686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa120a4-ad83-43bf-b1ce-f30428f887c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881331d51df44c7986e50f56f29c8ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:51Z,use_quota=True,user_id='284ff3cf7b824d8e9538fd7bc1e9efbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Creating volume baa120a4-ad83-43bf-b1ce-f30428f887c8 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:55:50 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:55:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-baa120a4-ad83-43bf-b1ce-f30428f887c8 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:50 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-baa120a4-ad83-43bf-b1ce-f30428f887c8 1073741824 Sep 16 17:55:50 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Flow 'volume_create_manager' (f9587348-0315-4583-b410-4f787f3560eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc45eef-6854-41fd-a542-47be87c7e781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc45eef-6854-41fd-a542-47be87c7e781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-703767115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73b70a9-01d1-406c-b0d2-21c31797477b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881331d51df44c7986e50f56f29c8ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:51Z,use_quota=True,user_id='284ff3cf7b824d8e9538fd7bc1e9efbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c57095-f21f-46b4-b4e6-6009cc7732fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c57095-f21f-46b4-b4e6-6009cc7732fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd47d79-0ea3-419b-aa4f-af59462e7e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd47d79-0ea3-419b-aa4f-af59462e7e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd73b70a9-01d1-406c-b0d2-21c31797477b', 'volume_name': 'volume-d73b70a9-01d1-406c-b0d2-21c31797477b', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1deed3-f9f5-442e-833e-2f5fa4e330f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1deed3-f9f5-442e-833e-2f5fa4e330f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf08a75-f410-475b-845d-c64e5309b88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:51 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Volume d73b70a9-01d1-406c-b0d2-21c31797477b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d73b70a9-01d1-406c-b0d2-21c31797477b', 'volume_size': 1} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:51 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-baa120a4-ad83-43bf-b1ce-f30428f887c8 1073741824" returned: 0 in 0.503s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-baa120a4-ad83-43bf-b1ce-f30428f887c8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:51 devstack sudo[104600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-baa120a4-ad83-43bf-b1ce-f30428f887c8 Sep 16 17:55:51 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Flow 'volume_create_manager' (872c99f8-0d96-4a38-9053-2d8badfbac98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c294e5a-4c90-4fea-a3b4-2fce8d93fe18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c294e5a-4c90-4fea-a3b4-2fce8d93fe18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-885653406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42999a83-e2a1-43f3-8e28-d807f2beab59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881331d51df44c7986e50f56f29c8ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:51Z,use_quota=True,user_id='284ff3cf7b824d8e9538fd7bc1e9efbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24daaf9-f848-4ad3-9f21-c9664b53be5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24daaf9-f848-4ad3-9f21-c9664b53be5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5ce101-26fe-4a14-a671-c8ffc3dbafcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5ce101-26fe-4a14-a671-c8ffc3dbafcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42999a83-e2a1-43f3-8e28-d807f2beab59', 'volume_name': 'volume-42999a83-e2a1-43f3-8e28-d807f2beab59', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a258fd51-e837-4c48-a599-319f3fffb5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a258fd51-e837-4c48-a599-319f3fffb5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a2cf4a-1313-45fd-ba41-3453e6551789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:51 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Volume 42999a83-e2a1-43f3-8e28-d807f2beab59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42999a83-e2a1-43f3-8e28-d807f2beab59', 'volume_size': 1} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:51 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-baa120a4-ad83-43bf-b1ce-f30428f887c8" returned: 0 in 0.256s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.424s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-703767115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73b70a9-01d1-406c-b0d2-21c31797477b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881331d51df44c7986e50f56f29c8ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:51Z,use_quota=True,user_id='284ff3cf7b824d8e9538fd7bc1e9efbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Creating volume d73b70a9-01d1-406c-b0d2-21c31797477b {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:55:51 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d73b70a9-01d1-406c-b0d2-21c31797477b 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:51 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d73b70a9-01d1-406c-b0d2-21c31797477b 1073741824 Sep 16 17:55:51 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1f080d-6483-49e8-a76d-affb8ae9cb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baa120a4-ad83-43bf-b1ce-f30428f887c8', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (438d4ecb-ee7c-408d-84a0-dd21eacc0e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:51 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Volume volume-baa120a4-ad83-43bf-b1ce-f30428f887c8 (baa120a4-ad83-43bf-b1ce-f30428f887c8): created successfully Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (438d4ecb-ee7c-408d-84a0-dd21eacc0e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Flow 'volume_create_manager' (7a3dcec5-385e-46f1-a94a-019b427040bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:51 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-f8f3a88e-43d0-4c27-aa63-eed9b514724e tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Created volume successfully. Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Flow 'volume_create_manager' (c4f44c8c-fa88-4f4d-9e89-c09b1482443c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc06c705-c28d-4e7b-9bc3-cb2cba46f03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc06c705-c28d-4e7b-9bc3-cb2cba46f03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-222158348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3ec1d6-b091-4524-bff1-ef71f8b5b75b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881331d51df44c7986e50f56f29c8ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:52Z,use_quota=True,user_id='284ff3cf7b824d8e9538fd7bc1e9efbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab87a78-b14e-4283-8275-b4a5ccf847c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab87a78-b14e-4283-8275-b4a5ccf847c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1554e582-a3d3-4e81-9257-da51da5becc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1554e582-a3d3-4e81-9257-da51da5becc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c3ec1d6-b091-4524-bff1-ef71f8b5b75b', 'volume_name': 'volume-5c3ec1d6-b091-4524-bff1-ef71f8b5b75b', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f977f7e2-0571-438d-b2c5-3b4ff776b230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f977f7e2-0571-438d-b2c5-3b4ff776b230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5601ae61-2351-4661-ac03-01f980308497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:51 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Volume 5c3ec1d6-b091-4524-bff1-ef71f8b5b75b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c3ec1d6-b091-4524-bff1-ef71f8b5b75b', 'volume_size': 1} Sep 16 17:55:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:52 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d73b70a9-01d1-406c-b0d2-21c31797477b 1073741824" returned: 0 in 0.536s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d73b70a9-01d1-406c-b0d2-21c31797477b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:55:52 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d73b70a9-01d1-406c-b0d2-21c31797477b Sep 16 17:55:52 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Flow 'volume_create_manager' (10fd306f-5f6f-4b1d-a758-6b29a11cfcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f41809b-354e-48cb-add1-03d3bb55558e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f41809b-354e-48cb-add1-03d3bb55558e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1927360307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4283716-8319-40cd-aaf9-59ea9f9de716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881331d51df44c7986e50f56f29c8ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:52Z,use_quota=True,user_id='284ff3cf7b824d8e9538fd7bc1e9efbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c56ef960-428f-41cb-9453-2304e98e41a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c56ef960-428f-41cb-9453-2304e98e41a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e89dd7f-ad3f-4811-867e-058666671021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e89dd7f-ad3f-4811-867e-058666671021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4283716-8319-40cd-aaf9-59ea9f9de716', 'volume_name': 'volume-a4283716-8319-40cd-aaf9-59ea9f9de716', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991271ea-b485-4b03-a06a-c02cf12604f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991271ea-b485-4b03-a06a-c02cf12604f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6aae546-0c76-4e11-a883-0970bcd8ff80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:52 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Volume a4283716-8319-40cd-aaf9-59ea9f9de716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4283716-8319-40cd-aaf9-59ea9f9de716', 'volume_size': 1} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:52 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d73b70a9-01d1-406c-b0d2-21c31797477b" returned: 0 in 0.241s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.883s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-885653406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42999a83-e2a1-43f3-8e28-d807f2beab59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881331d51df44c7986e50f56f29c8ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:51Z,use_quota=True,user_id='284ff3cf7b824d8e9538fd7bc1e9efbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Creating volume 42999a83-e2a1-43f3-8e28-d807f2beab59 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:55:52 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-42999a83-e2a1-43f3-8e28-d807f2beab59 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf08a75-f410-475b-845d-c64e5309b88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d73b70a9-01d1-406c-b0d2-21c31797477b', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:52 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-42999a83-e2a1-43f3-8e28-d807f2beab59 1073741824 Sep 16 17:55:52 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea477d7-ef8a-4290-8787-cabbb091ed8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:52 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Volume volume-d73b70a9-01d1-406c-b0d2-21c31797477b (d73b70a9-01d1-406c-b0d2-21c31797477b): created successfully Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea477d7-ef8a-4290-8787-cabbb091ed8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Flow 'volume_create_manager' (f9587348-0315-4583-b410-4f787f3560eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:52 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-598a358b-fa04-4d64-b732-7a6315c6c869 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Created volume successfully. Sep 16 17:55:52 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-42999a83-e2a1-43f3-8e28-d807f2beab59 1073741824" returned: 0 in 0.411s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-42999a83-e2a1-43f3-8e28-d807f2beab59 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:52 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-42999a83-e2a1-43f3-8e28-d807f2beab59 Sep 16 17:55:52 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:53 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-42999a83-e2a1-43f3-8e28-d807f2beab59" returned: 0 in 0.235s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.177s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-222158348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3ec1d6-b091-4524-bff1-ef71f8b5b75b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881331d51df44c7986e50f56f29c8ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:52Z,use_quota=True,user_id='284ff3cf7b824d8e9538fd7bc1e9efbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Creating volume 5c3ec1d6-b091-4524-bff1-ef71f8b5b75b {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:55:53 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5c3ec1d6-b091-4524-bff1-ef71f8b5b75b 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a2cf4a-1313-45fd-ba41-3453e6551789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42999a83-e2a1-43f3-8e28-d807f2beab59', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:53 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5c3ec1d6-b091-4524-bff1-ef71f8b5b75b 1073741824 Sep 16 17:55:53 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd2c57e-d652-46c5-bbf0-e8bf3c349573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:53 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Volume volume-42999a83-e2a1-43f3-8e28-d807f2beab59 (42999a83-e2a1-43f3-8e28-d807f2beab59): created successfully Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd2c57e-d652-46c5-bbf0-e8bf3c349573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Flow 'volume_create_manager' (872c99f8-0d96-4a38-9053-2d8badfbac98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:53 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-7ebcfa1b-d677-444b-b25f-e256a0d51c7b tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Created volume successfully. Sep 16 17:55:53 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5c3ec1d6-b091-4524-bff1-ef71f8b5b75b 1073741824" returned: 0 in 0.445s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5c3ec1d6-b091-4524-bff1-ef71f8b5b75b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:53 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5c3ec1d6-b091-4524-bff1-ef71f8b5b75b Sep 16 17:55:53 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:53 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5c3ec1d6-b091-4524-bff1-ef71f8b5b75b" returned: 0 in 0.239s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.596s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1927360307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4283716-8319-40cd-aaf9-59ea9f9de716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881331d51df44c7986e50f56f29c8ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:55:52Z,use_quota=True,user_id='284ff3cf7b824d8e9538fd7bc1e9efbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Creating volume a4283716-8319-40cd-aaf9-59ea9f9de716 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:55:53 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a4283716-8319-40cd-aaf9-59ea9f9de716 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5601ae61-2351-4661-ac03-01f980308497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c3ec1d6-b091-4524-bff1-ef71f8b5b75b', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:53 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a4283716-8319-40cd-aaf9-59ea9f9de716 1073741824 Sep 16 17:55:53 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fcf819b-c0cc-4c5c-8153-3868c53641da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:53 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Volume volume-5c3ec1d6-b091-4524-bff1-ef71f8b5b75b (5c3ec1d6-b091-4524-bff1-ef71f8b5b75b): created successfully Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fcf819b-c0cc-4c5c-8153-3868c53641da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Flow 'volume_create_manager' (c4f44c8c-fa88-4f4d-9e89-c09b1482443c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:53 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-c136b70a-7314-4b47-8fbd-3dc1168b30d1 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Created volume successfully. Sep 16 17:55:54 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a4283716-8319-40cd-aaf9-59ea9f9de716 1073741824" returned: 0 in 0.392s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a4283716-8319-40cd-aaf9-59ea9f9de716 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:54 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a4283716-8319-40cd-aaf9-59ea9f9de716 Sep 16 17:55:54 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:54 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a4283716-8319-40cd-aaf9-59ea9f9de716" returned: 0 in 0.259s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:54 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:55:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6aae546-0c76-4e11-a883-0970bcd8ff80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4283716-8319-40cd-aaf9-59ea9f9de716', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c916e9-0a61-4a46-acc7-914ae30e18cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:55:54 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Volume volume-a4283716-8319-40cd-aaf9-59ea9f9de716 (a4283716-8319-40cd-aaf9-59ea9f9de716): created successfully Sep 16 17:55:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c916e9-0a61-4a46-acc7-914ae30e18cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:55:54 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Flow 'volume_create_manager' (10fd306f-5f6f-4b1d-a758-6b29a11cfcef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:55:54 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-cd9cf39c-562e-4b9e-b232-5ff374f4441f tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Created volume successfully. Sep 16 17:55:55 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-15f62f56-af30-4f1d-b9ff-513f17f55eeb tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "cinder-a4283716-8319-40cd-aaf9-59ea9f9de716-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:55 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-15f62f56-af30-4f1d-b9ff-513f17f55eeb tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-a4283716-8319-40cd-aaf9-59ea9f9de716-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:55 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-15f62f56-af30-4f1d-b9ff-513f17f55eeb tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "cinder-quobyte-a4283716-8319-40cd-aaf9-59ea9f9de716" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:55 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-15f62f56-af30-4f1d-b9ff-513f17f55eeb tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-quobyte-a4283716-8319-40cd-aaf9-59ea9f9de716" acquired by "delete_volume" :: waited 0.014s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:55 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a71abf-57f7-4c37-90b3-227df160d166]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:55:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-15f62f56-af30-4f1d-b9ff-513f17f55eeb tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a4283716-8319-40cd-aaf9-59ea9f9de716 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:55 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a4283716-8319-40cd-aaf9-59ea9f9de716 Sep 16 17:55:55 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:55 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-15f62f56-af30-4f1d-b9ff-513f17f55eeb tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a4283716-8319-40cd-aaf9-59ea9f9de716" returned: 0 in 0.358s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-15f62f56-af30-4f1d-b9ff-513f17f55eeb tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a4283716-8319-40cd-aaf9-59ea9f9de716 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:56 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a4283716-8319-40cd-aaf9-59ea9f9de716 Sep 16 17:55:56 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:56 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-15f62f56-af30-4f1d-b9ff-513f17f55eeb tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a4283716-8319-40cd-aaf9-59ea9f9de716" returned: 0 in 0.240s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-15f62f56-af30-4f1d-b9ff-513f17f55eeb tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-quobyte-a4283716-8319-40cd-aaf9-59ea9f9de716" released by "delete_volume" :: held 0.637s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:56 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-15f62f56-af30-4f1d-b9ff-513f17f55eeb tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Created reservations ['60774bdc-a427-42db-9bf1-a3b0a8e62773', '092ec708-c541-45ed-9a20-327bc08d44bf', '2a8baecb-6cc9-41da-bdbf-af43c92ccfb8', '90b87be2-6240-44cb-83f4-909a15c892a0'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:55:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-15f62f56-af30-4f1d-b9ff-513f17f55eeb tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-15f62f56-af30-4f1d-b9ff-513f17f55eeb tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:56 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-15f62f56-af30-4f1d-b9ff-513f17f55eeb tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:56 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-15f62f56-af30-4f1d-b9ff-513f17f55eeb tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-15f62f56-af30-4f1d-b9ff-513f17f55eeb tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-15f62f56-af30-4f1d-b9ff-513f17f55eeb tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:56 devstack sudo[104646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:55:56 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:56 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-15f62f56-af30-4f1d-b9ff-513f17f55eeb tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.278s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:56 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-15f62f56-af30-4f1d-b9ff-513f17f55eeb tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:55:56 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-15f62f56-af30-4f1d-b9ff-513f17f55eeb tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Deleted volume successfully. Sep 16 17:55:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-15f62f56-af30-4f1d-b9ff-513f17f55eeb tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-a4283716-8319-40cd-aaf9-59ea9f9de716-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-20f33f58-5ca7-4444-b74a-9339594ae5b0 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "cinder-5c3ec1d6-b091-4524-bff1-ef71f8b5b75b-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-20f33f58-5ca7-4444-b74a-9339594ae5b0 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-5c3ec1d6-b091-4524-bff1-ef71f8b5b75b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-20f33f58-5ca7-4444-b74a-9339594ae5b0 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "cinder-quobyte-5c3ec1d6-b091-4524-bff1-ef71f8b5b75b" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-20f33f58-5ca7-4444-b74a-9339594ae5b0 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-quobyte-5c3ec1d6-b091-4524-bff1-ef71f8b5b75b" acquired by "delete_volume" :: waited 0.014s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:56 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f91b0a9-acde-49d2-8246-5c905edddb0d]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:55:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20f33f58-5ca7-4444-b74a-9339594ae5b0 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5c3ec1d6-b091-4524-bff1-ef71f8b5b75b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:56 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5c3ec1d6-b091-4524-bff1-ef71f8b5b75b Sep 16 17:55:56 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:57 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20f33f58-5ca7-4444-b74a-9339594ae5b0 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5c3ec1d6-b091-4524-bff1-ef71f8b5b75b" returned: 0 in 0.366s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20f33f58-5ca7-4444-b74a-9339594ae5b0 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5c3ec1d6-b091-4524-bff1-ef71f8b5b75b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:57 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5c3ec1d6-b091-4524-bff1-ef71f8b5b75b Sep 16 17:55:57 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:57 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20f33f58-5ca7-4444-b74a-9339594ae5b0 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5c3ec1d6-b091-4524-bff1-ef71f8b5b75b" returned: 0 in 0.238s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-20f33f58-5ca7-4444-b74a-9339594ae5b0 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-quobyte-5c3ec1d6-b091-4524-bff1-ef71f8b5b75b" released by "delete_volume" :: held 0.642s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:57 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-20f33f58-5ca7-4444-b74a-9339594ae5b0 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Created reservations ['89433a05-a5c5-4ef5-8d73-945f8a9bd4aa', '1e3b2c06-88cc-4ced-8bb0-51c3d0506810', '02ea5c7c-331b-489e-8133-0b3aaf0b406a', 'a5256c5d-8189-4ff6-b096-319474316742'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:55:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-20f33f58-5ca7-4444-b74a-9339594ae5b0 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-20f33f58-5ca7-4444-b74a-9339594ae5b0 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-20f33f58-5ca7-4444-b74a-9339594ae5b0 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-20f33f58-5ca7-4444-b74a-9339594ae5b0 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-20f33f58-5ca7-4444-b74a-9339594ae5b0 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20f33f58-5ca7-4444-b74a-9339594ae5b0 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:57 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:55:57 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:57 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-20f33f58-5ca7-4444-b74a-9339594ae5b0 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.242s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:57 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-20f33f58-5ca7-4444-b74a-9339594ae5b0 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:55:57 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-20f33f58-5ca7-4444-b74a-9339594ae5b0 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Deleted volume successfully. Sep 16 17:55:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-20f33f58-5ca7-4444-b74a-9339594ae5b0 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-5c3ec1d6-b091-4524-bff1-ef71f8b5b75b-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6fcfff46-2a42-46c9-9b67-d6cc90446ed6 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "cinder-42999a83-e2a1-43f3-8e28-d807f2beab59-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6fcfff46-2a42-46c9-9b67-d6cc90446ed6 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-42999a83-e2a1-43f3-8e28-d807f2beab59-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6fcfff46-2a42-46c9-9b67-d6cc90446ed6 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "cinder-quobyte-42999a83-e2a1-43f3-8e28-d807f2beab59" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6fcfff46-2a42-46c9-9b67-d6cc90446ed6 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-quobyte-42999a83-e2a1-43f3-8e28-d807f2beab59" acquired by "delete_volume" :: waited 0.014s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:57 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[328d7232-7706-4ff4-94ad-8276bb7bbd12]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:55:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6fcfff46-2a42-46c9-9b67-d6cc90446ed6 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-42999a83-e2a1-43f3-8e28-d807f2beab59 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:58 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-42999a83-e2a1-43f3-8e28-d807f2beab59 Sep 16 17:55:58 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:58 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6fcfff46-2a42-46c9-9b67-d6cc90446ed6 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-42999a83-e2a1-43f3-8e28-d807f2beab59" returned: 0 in 0.341s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6fcfff46-2a42-46c9-9b67-d6cc90446ed6 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-42999a83-e2a1-43f3-8e28-d807f2beab59 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:58 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-42999a83-e2a1-43f3-8e28-d807f2beab59 Sep 16 17:55:58 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:58 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6fcfff46-2a42-46c9-9b67-d6cc90446ed6 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-42999a83-e2a1-43f3-8e28-d807f2beab59" returned: 0 in 0.239s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6fcfff46-2a42-46c9-9b67-d6cc90446ed6 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-quobyte-42999a83-e2a1-43f3-8e28-d807f2beab59" released by "delete_volume" :: held 0.620s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:58 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-6fcfff46-2a42-46c9-9b67-d6cc90446ed6 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Created reservations ['25599f03-9b32-4936-9e56-781384dbadff', 'fa211b45-7de9-464a-a62d-8480ba9a9e8d', '0d7c9dcc-9f7e-438d-a78e-71810a4e1626', 'c538a061-8506-46c3-90b0-61ea0d0cbae4'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:55:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6fcfff46-2a42-46c9-9b67-d6cc90446ed6 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6fcfff46-2a42-46c9-9b67-d6cc90446ed6 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:58 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6fcfff46-2a42-46c9-9b67-d6cc90446ed6 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:58 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6fcfff46-2a42-46c9-9b67-d6cc90446ed6 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6fcfff46-2a42-46c9-9b67-d6cc90446ed6 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6fcfff46-2a42-46c9-9b67-d6cc90446ed6 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:58 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:55:58 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:58 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6fcfff46-2a42-46c9-9b67-d6cc90446ed6 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.233s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:58 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-6fcfff46-2a42-46c9-9b67-d6cc90446ed6 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:55:58 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-6fcfff46-2a42-46c9-9b67-d6cc90446ed6 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Deleted volume successfully. Sep 16 17:55:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6fcfff46-2a42-46c9-9b67-d6cc90446ed6 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-42999a83-e2a1-43f3-8e28-d807f2beab59-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5983b083-28bb-4815-a72d-0072930a6143 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "cinder-d73b70a9-01d1-406c-b0d2-21c31797477b-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5983b083-28bb-4815-a72d-0072930a6143 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-d73b70a9-01d1-406c-b0d2-21c31797477b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5983b083-28bb-4815-a72d-0072930a6143 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "cinder-quobyte-d73b70a9-01d1-406c-b0d2-21c31797477b" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:55:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5983b083-28bb-4815-a72d-0072930a6143 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-quobyte-d73b70a9-01d1-406c-b0d2-21c31797477b" acquired by "delete_volume" :: waited 0.014s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:55:59 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d31ffc-74c6-456b-9c22-ecaf1e4bb087]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:55:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5983b083-28bb-4815-a72d-0072930a6143 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d73b70a9-01d1-406c-b0d2-21c31797477b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:59 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d73b70a9-01d1-406c-b0d2-21c31797477b Sep 16 17:55:59 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:59 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5983b083-28bb-4815-a72d-0072930a6143 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d73b70a9-01d1-406c-b0d2-21c31797477b" returned: 0 in 0.356s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5983b083-28bb-4815-a72d-0072930a6143 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d73b70a9-01d1-406c-b0d2-21c31797477b {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:59 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d73b70a9-01d1-406c-b0d2-21c31797477b Sep 16 17:55:59 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:55:59 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Sep 16 17:55:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5983b083-28bb-4815-a72d-0072930a6143 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d73b70a9-01d1-406c-b0d2-21c31797477b" returned: 0 in 0.238s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:55:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5983b083-28bb-4815-a72d-0072930a6143 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-quobyte-d73b70a9-01d1-406c-b0d2-21c31797477b" released by "delete_volume" :: held 0.634s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:55:59 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:UPDATE=199,cinder:SELECT=126,cinder:INSERT=43,cinder:DELETE=15 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:55:59 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=131,cinder:UPDATE=168,cinder:INSERT=50,cinder:DELETE=19 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:55:59 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-5983b083-28bb-4815-a72d-0072930a6143 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Created reservations ['524ffe58-a5b6-45e3-977a-d515c2ebc949', 'a8983340-6543-4796-bdab-6bbc86ce0d5f', '7f2e1506-012c-4ba6-b961-443ee1dd2b7c', '2903f3ff-b38f-460e-ae5a-fb22616a3f3c'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:55:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5983b083-28bb-4815-a72d-0072930a6143 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:55:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5983b083-28bb-4815-a72d-0072930a6143 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:55:59 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5983b083-28bb-4815-a72d-0072930a6143 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:55:59 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5983b083-28bb-4815-a72d-0072930a6143 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:55:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5983b083-28bb-4815-a72d-0072930a6143 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:55:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5983b083-28bb-4815-a72d-0072930a6143 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:55:59 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:55:59 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:00 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5983b083-28bb-4815-a72d-0072930a6143 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.229s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:00 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-5983b083-28bb-4815-a72d-0072930a6143 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:56:00 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5983b083-28bb-4815-a72d-0072930a6143 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Deleted volume successfully. Sep 16 17:56:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5983b083-28bb-4815-a72d-0072930a6143 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-d73b70a9-01d1-406c-b0d2-21c31797477b-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-14f80946-ad42-4e5f-ad7a-9dfb12230f43 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "cinder-baa120a4-ad83-43bf-b1ce-f30428f887c8-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-14f80946-ad42-4e5f-ad7a-9dfb12230f43 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-baa120a4-ad83-43bf-b1ce-f30428f887c8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-14f80946-ad42-4e5f-ad7a-9dfb12230f43 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "cinder-quobyte-baa120a4-ad83-43bf-b1ce-f30428f887c8" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-14f80946-ad42-4e5f-ad7a-9dfb12230f43 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-quobyte-baa120a4-ad83-43bf-b1ce-f30428f887c8" acquired by "delete_volume" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:00 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b2c428-57e5-47b3-8480-2f33be15b370]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-14f80946-ad42-4e5f-ad7a-9dfb12230f43 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-baa120a4-ad83-43bf-b1ce-f30428f887c8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:00 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-baa120a4-ad83-43bf-b1ce-f30428f887c8 Sep 16 17:56:00 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:00 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-14f80946-ad42-4e5f-ad7a-9dfb12230f43 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-baa120a4-ad83-43bf-b1ce-f30428f887c8" returned: 0 in 0.364s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-14f80946-ad42-4e5f-ad7a-9dfb12230f43 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-baa120a4-ad83-43bf-b1ce-f30428f887c8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:00 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-baa120a4-ad83-43bf-b1ce-f30428f887c8 Sep 16 17:56:00 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:00 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-14f80946-ad42-4e5f-ad7a-9dfb12230f43 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-baa120a4-ad83-43bf-b1ce-f30428f887c8" returned: 0 in 0.242s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-14f80946-ad42-4e5f-ad7a-9dfb12230f43 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-quobyte-baa120a4-ad83-43bf-b1ce-f30428f887c8" released by "delete_volume" :: held 0.645s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:00 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-14f80946-ad42-4e5f-ad7a-9dfb12230f43 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Created reservations ['eb1890f2-55f7-417c-862d-8679092577df', 'e4b594b6-3fa5-4073-9b33-a7f6b24d6b30', 'aea2165a-9790-4375-91ee-1878fededab2', 'f92cb26c-a13e-474c-bf86-a2edbd185f19'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:56:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-14f80946-ad42-4e5f-ad7a-9dfb12230f43 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-14f80946-ad42-4e5f-ad7a-9dfb12230f43 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:01 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-14f80946-ad42-4e5f-ad7a-9dfb12230f43 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:01 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-14f80946-ad42-4e5f-ad7a-9dfb12230f43 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-14f80946-ad42-4e5f-ad7a-9dfb12230f43 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-14f80946-ad42-4e5f-ad7a-9dfb12230f43 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:01 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:56:01 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:01 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-14f80946-ad42-4e5f-ad7a-9dfb12230f43 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.242s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:01 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-14f80946-ad42-4e5f-ad7a-9dfb12230f43 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:56:01 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-14f80946-ad42-4e5f-ad7a-9dfb12230f43 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Deleted volume successfully. Sep 16 17:56:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-14f80946-ad42-4e5f-ad7a-9dfb12230f43 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-baa120a4-ad83-43bf-b1ce-f30428f887c8-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f1d98bc8-9db5-4b18-9d1b-7f09a9aacf48 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "cinder-236e9151-a168-4264-8e40-5ce76713a150-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f1d98bc8-9db5-4b18-9d1b-7f09a9aacf48 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-236e9151-a168-4264-8e40-5ce76713a150-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f1d98bc8-9db5-4b18-9d1b-7f09a9aacf48 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "cinder-quobyte-236e9151-a168-4264-8e40-5ce76713a150" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f1d98bc8-9db5-4b18-9d1b-7f09a9aacf48 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-quobyte-236e9151-a168-4264-8e40-5ce76713a150" acquired by "delete_volume" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:01 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a71373e-1fc9-4742-a222-6a9a06645e13]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f1d98bc8-9db5-4b18-9d1b-7f09a9aacf48 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-236e9151-a168-4264-8e40-5ce76713a150 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:01 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-236e9151-a168-4264-8e40-5ce76713a150 Sep 16 17:56:01 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:01 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f1d98bc8-9db5-4b18-9d1b-7f09a9aacf48 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-236e9151-a168-4264-8e40-5ce76713a150" returned: 0 in 0.352s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f1d98bc8-9db5-4b18-9d1b-7f09a9aacf48 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-236e9151-a168-4264-8e40-5ce76713a150 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:01 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-236e9151-a168-4264-8e40-5ce76713a150 Sep 16 17:56:01 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:02 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f1d98bc8-9db5-4b18-9d1b-7f09a9aacf48 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-236e9151-a168-4264-8e40-5ce76713a150" returned: 0 in 0.231s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f1d98bc8-9db5-4b18-9d1b-7f09a9aacf48 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-quobyte-236e9151-a168-4264-8e40-5ce76713a150" released by "delete_volume" :: held 0.623s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-f1d98bc8-9db5-4b18-9d1b-7f09a9aacf48 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Created reservations ['5f642b3f-cde7-439a-8077-ec7bab31030c', '8b0b3c2c-193a-48f8-9a68-00a45ddd77b7', 'cb386cdb-8bed-4519-a602-f25565a2ecb1', '09cb9f24-3e5d-4dc8-bf6a-dd6f9f266eec'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f1d98bc8-9db5-4b18-9d1b-7f09a9aacf48 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f1d98bc8-9db5-4b18-9d1b-7f09a9aacf48 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f1d98bc8-9db5-4b18-9d1b-7f09a9aacf48 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f1d98bc8-9db5-4b18-9d1b-7f09a9aacf48 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f1d98bc8-9db5-4b18-9d1b-7f09a9aacf48 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f1d98bc8-9db5-4b18-9d1b-7f09a9aacf48 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:02 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:56:02 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:02 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:56:02 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:02 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f1d98bc8-9db5-4b18-9d1b-7f09a9aacf48 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.259s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-f1d98bc8-9db5-4b18-9d1b-7f09a9aacf48 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:56:02 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-f1d98bc8-9db5-4b18-9d1b-7f09a9aacf48 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Deleted volume successfully. Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f1d98bc8-9db5-4b18-9d1b-7f09a9aacf48 tempest-CreateVolumesFromSourceVolumeTest-173296292 None] Lock "cinder-236e9151-a168-4264-8e40-5ce76713a150-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:02 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.259s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager._thread_info {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread count: 28 {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:56:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread info: [<_MainThread(MainThread, started 123748124422272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:56:12 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=13,cinder:INSERT=7,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:56:12 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:INSERT=5,cinder:UPDATE=25,cinder:SELECT=13,cinder:DELETE=1 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Flow 'volume_create_manager' (61acff2b-ae30-43a7-8d4d-1c9e1a7dc6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8cf338-067a-459b-8cc9-3d336fa19e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8cf338-067a-459b-8cc9-3d336fa19e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54be48e1-cd21-4eed-bdce-e494faff2fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696ed2b02f1b41379f3964aae2c07098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:14Z,use_quota=True,user_id='e5323c5ac00a47c0b7b3d3bd173d9c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702735bb-56a0-4788-9815-68ea75684498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702735bb-56a0-4788-9815-68ea75684498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720d3a6e-8cc4-496d-acbe-79364e07213e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720d3a6e-8cc4-496d-acbe-79364e07213e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54be48e1-cd21-4eed-bdce-e494faff2fed', 'volume_name': 'volume-54be48e1-cd21-4eed-bdce-e494faff2fed', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60b50da-4a89-47d2-82ac-475722909a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60b50da-4a89-47d2-82ac-475722909a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e2618ef-abc6-4a3a-ae25-d8c5c2da4557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:14 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Volume 54be48e1-cd21-4eed-bdce-e494faff2fed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54be48e1-cd21-4eed-bdce-e494faff2fed', 'volume_size': 1} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54be48e1-cd21-4eed-bdce-e494faff2fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696ed2b02f1b41379f3964aae2c07098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:14Z,use_quota=True,user_id='e5323c5ac00a47c0b7b3d3bd173d9c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Creating volume 54be48e1-cd21-4eed-bdce-e494faff2fed {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:56:14 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-54be48e1-cd21-4eed-bdce-e494faff2fed 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:14 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-54be48e1-cd21-4eed-bdce-e494faff2fed 1073741824 Sep 16 17:56:14 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Flow 'volume_create_manager' (fbbeead2-1022-4f4c-922f-9016065575e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc758d0a-281a-442c-b356-2102abf15b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc758d0a-281a-442c-b356-2102abf15b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-856136247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc5d876-33a6-4b58-940b-47804e97800d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314a95a707da4fafb87295e3b13cd182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:15Z,use_quota=True,user_id='bd93249fd1954083a81b3bf8f77b9e43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c7cfd9d-301a-4bd2-b03c-b431c19d0918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c7cfd9d-301a-4bd2-b03c-b431c19d0918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff523ac-1a9a-4c4e-bf2b-cfcdb806a9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff523ac-1a9a-4c4e-bf2b-cfcdb806a9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dc5d876-33a6-4b58-940b-47804e97800d', 'volume_name': 'volume-2dc5d876-33a6-4b58-940b-47804e97800d', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0d3906-123c-4128-862a-e89795ffd3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0d3906-123c-4128-862a-e89795ffd3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46fefedf-dbe2-4bb3-8da9-f39e892c15ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:14 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Volume 2dc5d876-33a6-4b58-940b-47804e97800d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dc5d876-33a6-4b58-940b-47804e97800d', 'volume_size': 1} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Flow 'volume_create_manager' (fe18b5e9-a55f-4ee0-aecc-3e85150029f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1515238e-3144-4e3b-9fd9-6bd1bc39c9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1515238e-3144-4e3b-9fd9-6bd1bc39c9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-403767956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb46864c-85ec-4ca4-a087-40b0e7fb6e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314a95a707da4fafb87295e3b13cd182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:15Z,use_quota=True,user_id='bd93249fd1954083a81b3bf8f77b9e43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99316b85-5988-4aab-a2af-6ee2f840c463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99316b85-5988-4aab-a2af-6ee2f840c463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ab0bc1-3aa7-48f2-9bb6-b13019018863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ab0bc1-3aa7-48f2-9bb6-b13019018863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb46864c-85ec-4ca4-a087-40b0e7fb6e88', 'volume_name': 'volume-bb46864c-85ec-4ca4-a087-40b0e7fb6e88', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1faaca09-ff89-4cd3-b907-cb8a86dc8be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1faaca09-ff89-4cd3-b907-cb8a86dc8be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (008495b2-cd9d-4299-848f-3287decc111c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:15 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Volume bb46864c-85ec-4ca4-a087-40b0e7fb6e88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb46864c-85ec-4ca4-a087-40b0e7fb6e88', 'volume_size': 1} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Flow 'volume_create_manager' (21780e95-8cd4-4b51-95f8-d1672547688b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf25ee98-60c1-434b-b334-92e40b480b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf25ee98-60c1-434b-b334-92e40b480b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-607305914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b585a614-9371-4139-b4ee-58d6691636aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86584e66b2b944ba9d609567dd5d3bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:15Z,use_quota=True,user_id='37b402b92b5749c2bc247f4ea7f392ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c640a86d-a31d-43c9-8ee2-eb4f7f3e2757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c640a86d-a31d-43c9-8ee2-eb4f7f3e2757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0afa45eb-0733-4bb5-8502-0c0639fb8d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0afa45eb-0733-4bb5-8502-0c0639fb8d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b585a614-9371-4139-b4ee-58d6691636aa', 'volume_name': 'volume-b585a614-9371-4139-b4ee-58d6691636aa', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe4587f-002d-4322-b2ef-465fa70d3880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe4587f-002d-4322-b2ef-465fa70d3880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81ef249-9d02-4a4a-9b24-fc0587ff5ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:15 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Volume b585a614-9371-4139-b4ee-58d6691636aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b585a614-9371-4139-b4ee-58d6691636aa', 'volume_size': 1} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:15 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-54be48e1-cd21-4eed-bdce-e494faff2fed 1073741824" returned: 0 in 0.765s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-54be48e1-cd21-4eed-bdce-e494faff2fed {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:15 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-54be48e1-cd21-4eed-bdce-e494faff2fed Sep 16 17:56:15 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Flow 'volume_create_manager' (3bbb86a8-3c54-4d7b-be75-3f9ee8463cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cece9ade-f6c9-4aec-bcda-82f6f1bfca67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cece9ade-f6c9-4aec-bcda-82f6f1bfca67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-816929030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676ec336-c9df-4136-839c-65966496dfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314a95a707da4fafb87295e3b13cd182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:15Z,use_quota=True,user_id='bd93249fd1954083a81b3bf8f77b9e43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa845fd1-c264-4e07-bcf2-45daffb57272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa845fd1-c264-4e07-bcf2-45daffb57272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdf10816-4d82-43b2-b219-b4a8516c8caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdf10816-4d82-43b2-b219-b4a8516c8caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '676ec336-c9df-4136-839c-65966496dfa9', 'volume_name': 'volume-676ec336-c9df-4136-839c-65966496dfa9', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578c5a89-90a4-4960-aef8-437d251fb737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578c5a89-90a4-4960-aef8-437d251fb737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f96c87c-6847-48f5-946f-1fe9a630fb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:15 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Volume 676ec336-c9df-4136-839c-65966496dfa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-676ec336-c9df-4136-839c-65966496dfa9', 'volume_size': 1} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:15 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-54be48e1-cd21-4eed-bdce-e494faff2fed" returned: 0 in 0.326s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.974s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-856136247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc5d876-33a6-4b58-940b-47804e97800d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314a95a707da4fafb87295e3b13cd182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:15Z,use_quota=True,user_id='bd93249fd1954083a81b3bf8f77b9e43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Creating volume 2dc5d876-33a6-4b58-940b-47804e97800d {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:56:15 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2dc5d876-33a6-4b58-940b-47804e97800d 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e2618ef-abc6-4a3a-ae25-d8c5c2da4557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54be48e1-cd21-4eed-bdce-e494faff2fed', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:15 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2dc5d876-33a6-4b58-940b-47804e97800d 1073741824 Sep 16 17:56:15 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c90b3f-5609-461e-9381-833e09b0282a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:15 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Volume volume-54be48e1-cd21-4eed-bdce-e494faff2fed (54be48e1-cd21-4eed-bdce-e494faff2fed): created successfully Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c90b3f-5609-461e-9381-833e09b0282a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Flow 'volume_create_manager' (61acff2b-ae30-43a7-8d4d-1c9e1a7dc6f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:15 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-459c326a-afd1-429b-bf3c-e01e93ce98ac tempest-CinderUnicodeTest-1867908558 None] Created volume successfully. Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Flow 'volume_create_manager' (02a17cff-ccc7-4981-be5b-8fd336ec7f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411615e2-8ecb-4cc4-a6a3-b1ba56d9cd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411615e2-8ecb-4cc4-a6a3-b1ba56d9cd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1086395301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0652dd8e-2024-4ab1-a435-963bd650af6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314a95a707da4fafb87295e3b13cd182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:16Z,use_quota=True,user_id='bd93249fd1954083a81b3bf8f77b9e43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b48c690-b50a-4832-aa57-b60c36d5a695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b48c690-b50a-4832-aa57-b60c36d5a695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629e176e-b3a6-4a96-a3cf-66b34ddd4e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629e176e-b3a6-4a96-a3cf-66b34ddd4e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0652dd8e-2024-4ab1-a435-963bd650af6d', 'volume_name': 'volume-0652dd8e-2024-4ab1-a435-963bd650af6d', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41773690-b64d-4ff8-81f8-b737e16f5212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41773690-b64d-4ff8-81f8-b737e16f5212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7732244-3b66-4a9e-ac5e-a08fdd315485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:16 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Volume 0652dd8e-2024-4ab1-a435-963bd650af6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0652dd8e-2024-4ab1-a435-963bd650af6d', 'volume_size': 1} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:16 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2dc5d876-33a6-4b58-940b-47804e97800d 1073741824" returned: 0 in 0.555s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2dc5d876-33a6-4b58-940b-47804e97800d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:16 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2dc5d876-33a6-4b58-940b-47804e97800d Sep 16 17:56:16 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Flow 'volume_create_manager' (8c73ba8e-2307-4be9-8d2f-2b8e47350776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b4e590-4e83-4c2b-bf21-e3ae54022996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b4e590-4e83-4c2b-bf21-e3ae54022996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-796397893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1ccbb0-aeda-49a3-8de1-98d4f19421f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314a95a707da4fafb87295e3b13cd182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:16Z,use_quota=True,user_id='bd93249fd1954083a81b3bf8f77b9e43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79f06aad-54f6-4490-ab9a-0dd73b855921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79f06aad-54f6-4490-ab9a-0dd73b855921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a002153-861f-4a6e-9ee5-168a7dc577fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a002153-861f-4a6e-9ee5-168a7dc577fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd1ccbb0-aeda-49a3-8de1-98d4f19421f4', 'volume_name': 'volume-bd1ccbb0-aeda-49a3-8de1-98d4f19421f4', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17deeea2-6028-4489-9415-53a1f6a72f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17deeea2-6028-4489-9415-53a1f6a72f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaca2e89-578b-4ec5-9857-27c90eff44a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:16 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Volume bd1ccbb0-aeda-49a3-8de1-98d4f19421f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd1ccbb0-aeda-49a3-8de1-98d4f19421f4', 'volume_size': 1} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:16 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2dc5d876-33a6-4b58-940b-47804e97800d" returned: 0 in 0.329s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.562s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-403767956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb46864c-85ec-4ca4-a087-40b0e7fb6e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314a95a707da4fafb87295e3b13cd182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:15Z,use_quota=True,user_id='bd93249fd1954083a81b3bf8f77b9e43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Creating volume bb46864c-85ec-4ca4-a087-40b0e7fb6e88 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:56:16 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb46864c-85ec-4ca4-a087-40b0e7fb6e88 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:16 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb46864c-85ec-4ca4-a087-40b0e7fb6e88 1073741824 Sep 16 17:56:16 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46fefedf-dbe2-4bb3-8da9-f39e892c15ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dc5d876-33a6-4b58-940b-47804e97800d', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a836ec-4371-4b27-ac4e-f611f7ba347c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:16 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Volume volume-2dc5d876-33a6-4b58-940b-47804e97800d (2dc5d876-33a6-4b58-940b-47804e97800d): created successfully Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a836ec-4371-4b27-ac4e-f611f7ba347c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:16 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Flow 'volume_create_manager' (fbbeead2-1022-4f4c-922f-9016065575e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:16 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-7a5238db-86bb-4e54-8557-3c983a5b29f9 tempest-CreateVolumesFromImageTest-1546470760 None] Created volume successfully. Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Flow 'volume_create_manager' (16a09123-ccdc-42f1-91c0-636e1e33df15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222455c7-25a3-4133-9155-6e912ce0ee65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222455c7-25a3-4133-9155-6e912ce0ee65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1255998680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79dba313-89cf-41e4-8aff-51b2c994b537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696ed2b02f1b41379f3964aae2c07098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:17Z,use_quota=True,user_id='e5323c5ac00a47c0b7b3d3bd173d9c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6928c4d9-1ba3-47e3-b574-b78e03532d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6928c4d9-1ba3-47e3-b574-b78e03532d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fed2ecd-5a13-4f4b-b14c-a16694080ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fed2ecd-5a13-4f4b-b14c-a16694080ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79dba313-89cf-41e4-8aff-51b2c994b537', 'volume_name': 'volume-79dba313-89cf-41e4-8aff-51b2c994b537', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12add6e5-4059-4d30-b241-f2877d187316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12add6e5-4059-4d30-b241-f2877d187316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9553e7-ec53-4e9f-8b67-9a3d756fd9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:17 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Volume 79dba313-89cf-41e4-8aff-51b2c994b537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79dba313-89cf-41e4-8aff-51b2c994b537', 'volume_size': 1} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:17 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb46864c-85ec-4ca4-a087-40b0e7fb6e88 1073741824" returned: 0 in 0.527s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb46864c-85ec-4ca4-a087-40b0e7fb6e88 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:17 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb46864c-85ec-4ca4-a087-40b0e7fb6e88 Sep 16 17:56:17 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:17 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb46864c-85ec-4ca4-a087-40b0e7fb6e88" returned: 0 in 0.279s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.222s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-607305914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b585a614-9371-4139-b4ee-58d6691636aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86584e66b2b944ba9d609567dd5d3bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:15Z,use_quota=True,user_id='37b402b92b5749c2bc247f4ea7f392ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Creating volume b585a614-9371-4139-b4ee-58d6691636aa {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:56:17 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b585a614-9371-4139-b4ee-58d6691636aa 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (008495b2-cd9d-4299-848f-3287decc111c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb46864c-85ec-4ca4-a087-40b0e7fb6e88', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d24775-f362-498f-ad9e-ec6eef550cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:17 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b585a614-9371-4139-b4ee-58d6691636aa 1073741824 Sep 16 17:56:17 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:17 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Volume volume-bb46864c-85ec-4ca4-a087-40b0e7fb6e88 (bb46864c-85ec-4ca4-a087-40b0e7fb6e88): created successfully Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d24775-f362-498f-ad9e-ec6eef550cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:17 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Flow 'volume_create_manager' (fe18b5e9-a55f-4ee0-aecc-3e85150029f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:17 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-f7883107-9e83-4995-842b-a54c193bb850 tempest-CreateVolumesFromImageTest-1546470760 None] Created volume successfully. Sep 16 17:56:18 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b585a614-9371-4139-b4ee-58d6691636aa 1073741824" returned: 0 in 0.489s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b585a614-9371-4139-b4ee-58d6691636aa {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:18 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b585a614-9371-4139-b4ee-58d6691636aa Sep 16 17:56:18 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:18 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b585a614-9371-4139-b4ee-58d6691636aa" returned: 0 in 0.262s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.798s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-816929030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676ec336-c9df-4136-839c-65966496dfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314a95a707da4fafb87295e3b13cd182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:15Z,use_quota=True,user_id='bd93249fd1954083a81b3bf8f77b9e43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Creating volume 676ec336-c9df-4136-839c-65966496dfa9 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:56:18 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-676ec336-c9df-4136-839c-65966496dfa9 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81ef249-9d02-4a4a-9b24-fc0587ff5ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b585a614-9371-4139-b4ee-58d6691636aa', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130eb3ba-bf37-45ad-807b-f31ed620d043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:18 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-676ec336-c9df-4136-839c-65966496dfa9 1073741824 Sep 16 17:56:18 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:18 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Volume volume-b585a614-9371-4139-b4ee-58d6691636aa (b585a614-9371-4139-b4ee-58d6691636aa): created successfully Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130eb3ba-bf37-45ad-807b-f31ed620d043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Flow 'volume_create_manager' (21780e95-8cd4-4b51-95f8-d1672547688b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:18 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-c4cc3711-6578-4f56-93d3-6666056fb90f tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Created volume successfully. Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Flow 'volume_create_manager' (e8877181-b42d-4997-af15-c28ac24a8c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c6d31e-aef1-470a-abe7-f89a9d32c02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c6d31e-aef1-470a-abe7-f89a9d32c02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=587cd10a-917e-4a4e-9f78-17821b7fad1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab0e5f6b454426590dfc9d7495c098c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:19Z,use_quota=True,user_id='0f8448274c7740ef8ec403b1cf9995b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eac71f3b-cf76-40e3-a5b0-dd6141a3f69d),volume_type_id=eac71f3b-cf76-40e3-a5b0-dd6141a3f69d)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f52fdf1-7812-4571-865d-84d3cf007e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f52fdf1-7812-4571-865d-84d3cf007e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd312459-6037-42dc-bdc6-7b1c2e585957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG cinder.image.glance [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Creating Keystone auth plugin from conf {{(pid=85899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 17:56:18 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-676ec336-c9df-4136-839c-65966496dfa9 1073741824" returned: 0 in 0.480s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-676ec336-c9df-4136-839c-65966496dfa9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:18 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-676ec336-c9df-4136-839c-65966496dfa9 Sep 16 17:56:18 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd312459-6037-42dc-bdc6-7b1c2e585957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '587cd10a-917e-4a4e-9f78-17821b7fad1c', 'volume_name': 'volume-587cd10a-917e-4a4e-9f78-17821b7fad1c', 'volume_size': 1, 'image_id': '8b33d6f6-662e-4e95-b315-d45930a2484e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b33d6f6-662e-4e95-b315-d45930a2484e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f2a8c117c0783ceb0d01f34d285dcc15', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8ab0e5f6b454426590dfc9d7495c098c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd8f73de8181a0ae327d2aae6115fb8034a7839e594a6a221d04eb86d2d0f3e0e15681123f4e0dfd17ebe4bc07da4f6938438adce614652370fdda02e7d18a7b0', 'id': '8b33d6f6-662e-4e95-b315-d45930a2484e', 'created_at': datetime.datetime(2026, 9, 16, 15, 56, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 56, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b33d6f6-662e-4e95-b315-d45930a2484e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4f3f61-ae23-46b8-8f38-224e487040f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4f3f61-ae23-46b8-8f38-224e487040f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6749e203-91be-4d34-8eef-457e66e82e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:19 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Volume 587cd10a-917e-4a4e-9f78-17821b7fad1c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-587cd10a-917e-4a4e-9f78-17821b7fad1c', 'volume_size': 1, 'image_id': '8b33d6f6-662e-4e95-b315-d45930a2484e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b33d6f6-662e-4e95-b315-d45930a2484e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f2a8c117c0783ceb0d01f34d285dcc15', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8ab0e5f6b454426590dfc9d7495c098c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd8f73de8181a0ae327d2aae6115fb8034a7839e594a6a221d04eb86d2d0f3e0e15681123f4e0dfd17ebe4bc07da4f6938438adce614652370fdda02e7d18a7b0', 'id': '8b33d6f6-662e-4e95-b315-d45930a2484e', 'created_at': datetime.datetime(2026, 9, 16, 15, 56, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 56, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b33d6f6-662e-4e95-b315-d45930a2484e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Trying to clone 587cd10a-917e-4a4e-9f78-17821b7fad1c from image 8b33d6f6-662e-4e95-b315-d45930a2484e at location (None, [{'url': 'file:///opt/stack/data/glance/images/8b33d6f6-662e-4e95-b315-d45930a2484e', 'metadata': {}}]). {{(pid=85899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 16 17:56:19 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Image download 0.00 MB at 0.00 MB/s Sep 16 17:56:19 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-676ec336-c9df-4136-839c-65966496dfa9" returned: 0 in 0.263s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ce4438-bd3f-4c61-bf72-6a9a847ba0da]: (4, 'raw') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.140s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1086395301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0652dd8e-2024-4ab1-a435-963bd650af6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314a95a707da4fafb87295e3b13cd182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:16Z,use_quota=True,user_id='bd93249fd1954083a81b3bf8f77b9e43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Creating volume 0652dd8e-2024-4ab1-a435-963bd650af6d {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:56:19 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0652dd8e-2024-4ab1-a435-963bd650af6d 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:19 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0652dd8e-2024-4ab1-a435-963bd650af6d 1073741824 Sep 16 17:56:19 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f96c87c-6847-48f5-946f-1fe9a630fb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-676ec336-c9df-4136-839c-65966496dfa9', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ef6166-79d3-4120-a1a9-672d0e166e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:19 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Volume volume-676ec336-c9df-4136-839c-65966496dfa9 (676ec336-c9df-4136-839c-65966496dfa9): created successfully Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ef6166-79d3-4120-a1a9-672d0e166e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Flow 'volume_create_manager' (3bbb86a8-3c54-4d7b-be75-3f9ee8463cba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:19 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-7b69e00c-593b-4587-beb6-38295ea7f3f7 tempest-CreateVolumesFromImageTest-1546470760 None] Created volume successfully. Sep 16 17:56:19 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD Sep 16 17:56:19 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:19 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:19 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD Sep 16 17:56:19 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:19 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0652dd8e-2024-4ab1-a435-963bd650af6d 1073741824" returned: 0 in 0.613s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0652dd8e-2024-4ab1-a435-963bd650af6d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:19 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0652dd8e-2024-4ab1-a435-963bd650af6d Sep 16 17:56:19 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:56:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Flow 'volume_create_manager' (7232a89d-e2b7-495c-9b53-f28474c507bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ec5f2b-fb35-43e2-a6c5-7494388528fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:20 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ec5f2b-fb35-43e2-a6c5-7494388528fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-155506862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed65d3b2-5a44-4b00-860f-cdc8bb44c07f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86584e66b2b944ba9d609567dd5d3bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:20Z,use_quota=True,user_id='37b402b92b5749c2bc247f4ea7f392ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6798f37b-e4a5-4b4d-9507-009798e934e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6798f37b-e4a5-4b4d-9507-009798e934e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f925af6-1b57-490b-bb8b-a12759fc50f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f925af6-1b57-490b-bb8b-a12759fc50f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed65d3b2-5a44-4b00-860f-cdc8bb44c07f', 'volume_name': 'volume-ed65d3b2-5a44-4b00-860f-cdc8bb44c07f', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c46ffe-51da-4ff7-8fd4-08301f6c59bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c46ffe-51da-4ff7-8fd4-08301f6c59bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2cbf44-50b3-4531-bc64-b2fceb5aa3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:20 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Volume ed65d3b2-5a44-4b00-860f-cdc8bb44c07f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed65d3b2-5a44-4b00-860f-cdc8bb44c07f', 'volume_size': 1} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD" returned: 1 in 0.509s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Temporary image 8b33d6f6-662e-4e95-b315-d45930a2484e is fetched for user 0f8448274c7740ef8ec403b1cf9995b0. {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a409df0-9975-4a3d-9da1-796fd7e43ed0]: (4, 'raw') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:20 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0652dd8e-2024-4ab1-a435-963bd650af6d" returned: 0 in 0.301s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.558s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-796397893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1ccbb0-aeda-49a3-8de1-98d4f19421f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314a95a707da4fafb87295e3b13cd182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:16Z,use_quota=True,user_id='bd93249fd1954083a81b3bf8f77b9e43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Creating volume bd1ccbb0-aeda-49a3-8de1-98d4f19421f4 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:56:20 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bd1ccbb0-aeda-49a3-8de1-98d4f19421f4 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:20 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bd1ccbb0-aeda-49a3-8de1-98d4f19421f4 1073741824 Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7732244-3b66-4a9e-ac5e-a08fdd315485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0652dd8e-2024-4ab1-a435-963bd650af6d', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:20 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf16b63b-f2f1-471b-a668-761f876fdb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:20 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Volume volume-0652dd8e-2024-4ab1-a435-963bd650af6d (0652dd8e-2024-4ab1-a435-963bd650af6d): created successfully Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf16b63b-f2f1-471b-a668-761f876fdb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Flow 'volume_create_manager' (02a17cff-ccc7-4981-be5b-8fd336ec7f40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:20 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-a021ec68-2096-4419-a162-260ee92e7603 tempest-CreateVolumesFromImageTest-1546470760 None] Created volume successfully. Sep 16 17:56:20 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD Sep 16 17:56:20 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:20 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:56:20 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Flow 'volume_create_manager' (132dfbd7-44a1-4067-b182-16f92cf65295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23060df-cf8a-4336-9c8d-1afc881f110b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:20 devstack sudo[104823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD Sep 16 17:56:20 devstack sudo[104823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bd1ccbb0-aeda-49a3-8de1-98d4f19421f4 1073741824" returned: 0 in 0.598s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23060df-cf8a-4336-9c8d-1afc881f110b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-692167902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7865407d-b0d7-471a-bbc4-5e4b7191998a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86584e66b2b944ba9d609567dd5d3bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:21Z,use_quota=True,user_id='37b402b92b5749c2bc247f4ea7f392ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b468d721-b36d-420b-b31e-3731e595eb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b468d721-b36d-420b-b31e-3731e595eb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c09e309-6e83-4533-8199-fc6433c3f979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c09e309-6e83-4533-8199-fc6433c3f979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7865407d-b0d7-471a-bbc4-5e4b7191998a', 'volume_name': 'volume-7865407d-b0d7-471a-bbc4-5e4b7191998a', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75582a82-e5b6-4ae2-9ecf-25f32cd88c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75582a82-e5b6-4ae2-9ecf-25f32cd88c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a097b6f-96e9-491a-85a1-4fbd9e683e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:20 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Volume 7865407d-b0d7-471a-bbc4-5e4b7191998a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7865407d-b0d7-471a-bbc4-5e4b7191998a', 'volume_size': 1} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bd1ccbb0-aeda-49a3-8de1-98d4f19421f4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:20 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bd1ccbb0-aeda-49a3-8de1-98d4f19421f4 Sep 16 17:56:20 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:21 devstack sudo[104823]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD" returned: 1 in 0.473s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Flow 'volume_create_manager' (ef8e0848-ed39-4baa-a8fb-807d1a006ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f50df3-e255-4e98-ac18-d54e6d1098b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f50df3-e255-4e98-ac18-d54e6d1098b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1639329801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f932a4f4-c10c-4d84-94a1-19f3cbf18854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86584e66b2b944ba9d609567dd5d3bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:21Z,use_quota=True,user_id='37b402b92b5749c2bc247f4ea7f392ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea7895b-1f30-4dc6-a695-7d403ec7414e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea7895b-1f30-4dc6-a695-7d403ec7414e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e488ab-4007-40c6-bd67-1eed4535f4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e488ab-4007-40c6-bd67-1eed4535f4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f932a4f4-c10c-4d84-94a1-19f3cbf18854', 'volume_name': 'volume-f932a4f4-c10c-4d84-94a1-19f3cbf18854', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2eb286d-f9ba-4a91-9bdf-7897e2cada2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2eb286d-f9ba-4a91-9bdf-7897e2cada2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7cd145f-1be2-4a67-8131-eea10f06f7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:21 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Volume f932a4f4-c10c-4d84-94a1-19f3cbf18854: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f932a4f4-c10c-4d84-94a1-19f3cbf18854', 'volume_size': 1} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:21 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bd1ccbb0-aeda-49a3-8de1-98d4f19421f4" returned: 0 in 0.314s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.968s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1255998680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79dba313-89cf-41e4-8aff-51b2c994b537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696ed2b02f1b41379f3964aae2c07098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:17Z,use_quota=True,user_id='e5323c5ac00a47c0b7b3d3bd173d9c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Creating volume 79dba313-89cf-41e4-8aff-51b2c994b537 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:56:21 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaca2e89-578b-4ec5-9857-27c90eff44a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd1ccbb0-aeda-49a3-8de1-98d4f19421f4', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:21 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537 1073741824 Sep 16 17:56:21 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a74ca6-24e4-4288-be2e-bbff226b24d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:21 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Volume volume-bd1ccbb0-aeda-49a3-8de1-98d4f19421f4 (bd1ccbb0-aeda-49a3-8de1-98d4f19421f4): created successfully Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a74ca6-24e4-4288-be2e-bbff226b24d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Flow 'volume_create_manager' (8c73ba8e-2307-4be9-8d2f-2b8e47350776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:21 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-61b15370-da1e-4c00-af8d-a58bbd7c8bf5 tempest-CreateVolumesFromImageTest-1546470760 None] Created volume successfully. Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Flow 'volume_create_manager' (46d127d5-a64e-4a6c-80dd-b16d7e92918b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76082bb2-8c8a-450d-85b2-9f83474dbe86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76082bb2-8c8a-450d-85b2-9f83474dbe86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-21568095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de38df12-604f-4a27-92d8-7f556fa4b730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86584e66b2b944ba9d609567dd5d3bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:21Z,use_quota=True,user_id='37b402b92b5749c2bc247f4ea7f392ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdae8bdc-01f3-4a7c-926c-9348d5364981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdae8bdc-01f3-4a7c-926c-9348d5364981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d091f44d-f0f8-4e18-9e64-5749600da64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d091f44d-f0f8-4e18-9e64-5749600da64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de38df12-604f-4a27-92d8-7f556fa4b730', 'volume_name': 'volume-de38df12-604f-4a27-92d8-7f556fa4b730', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d39a62-ff78-4dbd-ad83-14f8ff85062e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d39a62-ff78-4dbd-ad83-14f8ff85062e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd7c07c-e807-4b66-95dd-a4d907feb828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:21 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Volume de38df12-604f-4a27-92d8-7f556fa4b730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de38df12-604f-4a27-92d8-7f556fa4b730', 'volume_size': 1} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:21 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537 1073741824" returned: 0 in 0.557s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:21 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537 Sep 16 17:56:21 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Flow 'volume_create_manager' (af5d59d7-5bc0-492e-8789-b8dad2adc3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f0b596-3156-462d-a851-32d33de72020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f0b596-3156-462d-a851-32d33de72020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2087797624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0340d399-f350-432d-953f-8c522b9d99ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86584e66b2b944ba9d609567dd5d3bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:22Z,use_quota=True,user_id='37b402b92b5749c2bc247f4ea7f392ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6c7af6-9873-417a-972f-93e1c53f38ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6c7af6-9873-417a-972f-93e1c53f38ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5aee39f-f483-4402-8392-0e333478439a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5aee39f-f483-4402-8392-0e333478439a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0340d399-f350-432d-953f-8c522b9d99ec', 'volume_name': 'volume-0340d399-f350-432d-953f-8c522b9d99ec', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d2f6e4-3dbe-4fea-807f-0a51d79d63bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d2f6e4-3dbe-4fea-807f-0a51d79d63bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f28b3ff-6d75-4b12-8282-3bee725fbf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:21 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Volume 0340d399-f350-432d-953f-8c522b9d99ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0340d399-f350-432d-953f-8c522b9d99ec', 'volume_size': 1} Sep 16 17:56:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:22 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537" returned: 0 in 0.241s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.999s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-155506862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed65d3b2-5a44-4b00-860f-cdc8bb44c07f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86584e66b2b944ba9d609567dd5d3bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:20Z,use_quota=True,user_id='37b402b92b5749c2bc247f4ea7f392ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Creating volume ed65d3b2-5a44-4b00-860f-cdc8bb44c07f {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:56:22 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ed65d3b2-5a44-4b00-860f-cdc8bb44c07f 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f008c04f-dcc2-4062-a7d7-f77391cec54f tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "cinder-bd1ccbb0-aeda-49a3-8de1-98d4f19421f4-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:22 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ed65d3b2-5a44-4b00-860f-cdc8bb44c07f 1073741824 Sep 16 17:56:22 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9553e7-ec53-4e9f-8b67-9a3d756fd9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79dba313-89cf-41e4-8aff-51b2c994b537', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85cd89fd-8cab-476b-bbc6-2281bda291fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f008c04f-dcc2-4062-a7d7-f77391cec54f tempest-CreateVolumesFromImageTest-1546470760 None] Lock "cinder-bd1ccbb0-aeda-49a3-8de1-98d4f19421f4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:22 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Volume volume-79dba313-89cf-41e4-8aff-51b2c994b537 (79dba313-89cf-41e4-8aff-51b2c994b537): created successfully Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85cd89fd-8cab-476b-bbc6-2281bda291fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Flow 'volume_create_manager' (16a09123-ccdc-42f1-91c0-636e1e33df15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:22 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-a209ca63-15c7-415b-b9ea-26f8246ed566 tempest-CinderUnicodeTest-1867908558 None] Created volume successfully. Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f008c04f-dcc2-4062-a7d7-f77391cec54f tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "cinder-quobyte-bd1ccbb0-aeda-49a3-8de1-98d4f19421f4" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f008c04f-dcc2-4062-a7d7-f77391cec54f tempest-CreateVolumesFromImageTest-1546470760 None] Lock "cinder-quobyte-bd1ccbb0-aeda-49a3-8de1-98d4f19421f4" acquired by "delete_volume" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4ed440-db01-434b-98b6-992b48732903]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f008c04f-dcc2-4062-a7d7-f77391cec54f tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bd1ccbb0-aeda-49a3-8de1-98d4f19421f4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:22 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bd1ccbb0-aeda-49a3-8de1-98d4f19421f4 Sep 16 17:56:22 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:22 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ed65d3b2-5a44-4b00-860f-cdc8bb44c07f 1073741824" returned: 0 in 0.501s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:22 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ed65d3b2-5a44-4b00-860f-cdc8bb44c07f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f008c04f-dcc2-4062-a7d7-f77391cec54f tempest-CreateVolumesFromImageTest-1546470760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bd1ccbb0-aeda-49a3-8de1-98d4f19421f4" returned: 0 in 0.409s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f008c04f-dcc2-4062-a7d7-f77391cec54f tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bd1ccbb0-aeda-49a3-8de1-98d4f19421f4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:22 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ed65d3b2-5a44-4b00-860f-cdc8bb44c07f Sep 16 17:56:22 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:22 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bd1ccbb0-aeda-49a3-8de1-98d4f19421f4 Sep 16 17:56:22 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e7814399-e0e9-48d8-b0bb-7035e34945e4 tempest-CinderUnicodeTest-1867908558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:22 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ed65d3b2-5a44-4b00-860f-cdc8bb44c07f" returned: 0 in 0.301s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.093s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-692167902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7865407d-b0d7-471a-bbc4-5e4b7191998a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86584e66b2b944ba9d609567dd5d3bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:21Z,use_quota=True,user_id='37b402b92b5749c2bc247f4ea7f392ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Creating volume 7865407d-b0d7-471a-bbc4-5e4b7191998a {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:56:22 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7865407d-b0d7-471a-bbc4-5e4b7191998a 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:22 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f008c04f-dcc2-4062-a7d7-f77391cec54f tempest-CreateVolumesFromImageTest-1546470760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bd1ccbb0-aeda-49a3-8de1-98d4f19421f4" returned: 0 in 0.320s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:22 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7865407d-b0d7-471a-bbc4-5e4b7191998a 1073741824 Sep 16 17:56:22 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2cbf44-50b3-4531-bc64-b2fceb5aa3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed65d3b2-5a44-4b00-860f-cdc8bb44c07f', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b10498d-e477-4ca9-9b4c-d5ee6ababde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f008c04f-dcc2-4062-a7d7-f77391cec54f tempest-CreateVolumesFromImageTest-1546470760 None] Lock "cinder-quobyte-bd1ccbb0-aeda-49a3-8de1-98d4f19421f4" released by "delete_volume" :: held 0.788s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:23 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Volume volume-ed65d3b2-5a44-4b00-860f-cdc8bb44c07f (ed65d3b2-5a44-4b00-860f-cdc8bb44c07f): created successfully Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b10498d-e477-4ca9-9b4c-d5ee6ababde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Flow 'volume_create_manager' (7232a89d-e2b7-495c-9b53-f28474c507bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:23 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-a270306b-3573-4cb0-aefc-4193dad1ab13 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Created volume successfully. Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-f008c04f-dcc2-4062-a7d7-f77391cec54f tempest-CreateVolumesFromImageTest-1546470760 None] Created reservations ['6e90c221-ef99-4f97-98df-e0a62dfe97b1', '83c86967-4613-44ac-b7ca-543ea8520da1', 'b2ac6a8f-7f27-4ead-99f9-33a594f0a901', 'c68c0a85-ac7c-486d-bafb-4fbe6b22593c'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f008c04f-dcc2-4062-a7d7-f77391cec54f tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f008c04f-dcc2-4062-a7d7-f77391cec54f tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f008c04f-dcc2-4062-a7d7-f77391cec54f tempest-CreateVolumesFromImageTest-1546470760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f008c04f-dcc2-4062-a7d7-f77391cec54f tempest-CreateVolumesFromImageTest-1546470760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f008c04f-dcc2-4062-a7d7-f77391cec54f tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f008c04f-dcc2-4062-a7d7-f77391cec54f tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:23 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:56:23 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ef090578-e40e-4748-9ad0-5272a16060b0 tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "cinder-0652dd8e-2024-4ab1-a435-963bd650af6d-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ef090578-e40e-4748-9ad0-5272a16060b0 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "cinder-0652dd8e-2024-4ab1-a435-963bd650af6d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ef090578-e40e-4748-9ad0-5272a16060b0 tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "cinder-quobyte-0652dd8e-2024-4ab1-a435-963bd650af6d" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ef090578-e40e-4748-9ad0-5272a16060b0 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "cinder-quobyte-0652dd8e-2024-4ab1-a435-963bd650af6d" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[655432c8-35e8-4383-be28-6a4b64d8d306]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ef090578-e40e-4748-9ad0-5272a16060b0 tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0652dd8e-2024-4ab1-a435-963bd650af6d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:23 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f008c04f-dcc2-4062-a7d7-f77391cec54f tempest-CreateVolumesFromImageTest-1546470760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.294s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-f008c04f-dcc2-4062-a7d7-f77391cec54f tempest-CreateVolumesFromImageTest-1546470760 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:56:23 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-f008c04f-dcc2-4062-a7d7-f77391cec54f tempest-CreateVolumesFromImageTest-1546470760 None] Deleted volume successfully. Sep 16 17:56:23 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7865407d-b0d7-471a-bbc4-5e4b7191998a 1073741824" returned: 0 in 0.506s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f008c04f-dcc2-4062-a7d7-f77391cec54f tempest-CreateVolumesFromImageTest-1546470760 None] Lock "cinder-bd1ccbb0-aeda-49a3-8de1-98d4f19421f4-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7865407d-b0d7-471a-bbc4-5e4b7191998a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:23 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0652dd8e-2024-4ab1-a435-963bd650af6d Sep 16 17:56:23 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:23 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7865407d-b0d7-471a-bbc4-5e4b7191998a Sep 16 17:56:23 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:23 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7865407d-b0d7-471a-bbc4-5e4b7191998a" returned: 0 in 0.274s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.687s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=587cd10a-917e-4a4e-9f78-17821b7fad1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab0e5f6b454426590dfc9d7495c098c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:19Z,use_quota=True,user_id='0f8448274c7740ef8ec403b1cf9995b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eac71f3b-cf76-40e3-a5b0-dd6141a3f69d),volume_type_id=eac71f3b-cf76-40e3-a5b0-dd6141a3f69d)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Creating volume 587cd10a-917e-4a4e-9f78-17821b7fad1c {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:23 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:56:23 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-587cd10a-917e-4a4e-9f78-17821b7fad1c 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ef090578-e40e-4748-9ad0-5272a16060b0 tempest-CreateVolumesFromImageTest-1546470760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0652dd8e-2024-4ab1-a435-963bd650af6d" returned: 0 in 0.402s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ef090578-e40e-4748-9ad0-5272a16060b0 tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0652dd8e-2024-4ab1-a435-963bd650af6d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:23 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-587cd10a-917e-4a4e-9f78-17821b7fad1c 1073741824 Sep 16 17:56:23 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a097b6f-96e9-491a-85a1-4fbd9e683e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7865407d-b0d7-471a-bbc4-5e4b7191998a', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:23 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0652dd8e-2024-4ab1-a435-963bd650af6d Sep 16 17:56:23 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cda7c6a-b779-447a-876f-f2c7f827691a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:23 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Volume volume-7865407d-b0d7-471a-bbc4-5e4b7191998a (7865407d-b0d7-471a-bbc4-5e4b7191998a): created successfully Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cda7c6a-b779-447a-876f-f2c7f827691a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:23 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Flow 'volume_create_manager' (132dfbd7-44a1-4067-b182-16f92cf65295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:23 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-90bb4e58-4db9-4e51-adbe-1c5f3781c698 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Created volume successfully. Sep 16 17:56:24 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ef090578-e40e-4748-9ad0-5272a16060b0 tempest-CreateVolumesFromImageTest-1546470760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0652dd8e-2024-4ab1-a435-963bd650af6d" returned: 0 in 0.289s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ef090578-e40e-4748-9ad0-5272a16060b0 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "cinder-quobyte-0652dd8e-2024-4ab1-a435-963bd650af6d" released by "delete_volume" :: held 0.742s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-ef090578-e40e-4748-9ad0-5272a16060b0 tempest-CreateVolumesFromImageTest-1546470760 None] Created reservations ['f82550a2-3391-44c0-a69f-3161369d5fad', 'b8a5493e-f3d7-4ebd-9170-8533e1ef0e24', '4060caca-f964-45cc-87bd-b5aa2781fd1d', '8c9165f2-9e44-4315-a883-9d9b33113b9a'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ef090578-e40e-4748-9ad0-5272a16060b0 tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ef090578-e40e-4748-9ad0-5272a16060b0 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ef090578-e40e-4748-9ad0-5272a16060b0 tempest-CreateVolumesFromImageTest-1546470760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ef090578-e40e-4748-9ad0-5272a16060b0 tempest-CreateVolumesFromImageTest-1546470760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ef090578-e40e-4748-9ad0-5272a16060b0 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ef090578-e40e-4748-9ad0-5272a16060b0 tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:24 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:56:24 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:24 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-587cd10a-917e-4a4e-9f78-17821b7fad1c 1073741824" returned: 0 in 0.536s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-587cd10a-917e-4a4e-9f78-17821b7fad1c {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:24 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-587cd10a-917e-4a4e-9f78-17821b7fad1c Sep 16 17:56:24 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cfa1edd1-4233-4dfe-aabe-a678fc9c4777 tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "cinder-676ec336-c9df-4136-839c-65966496dfa9-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cfa1edd1-4233-4dfe-aabe-a678fc9c4777 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "cinder-676ec336-c9df-4136-839c-65966496dfa9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cfa1edd1-4233-4dfe-aabe-a678fc9c4777 tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "cinder-quobyte-676ec336-c9df-4136-839c-65966496dfa9" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:24 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ef090578-e40e-4748-9ad0-5272a16060b0 tempest-CreateVolumesFromImageTest-1546470760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.283s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-ef090578-e40e-4748-9ad0-5272a16060b0 tempest-CreateVolumesFromImageTest-1546470760 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:56:24 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-ef090578-e40e-4748-9ad0-5272a16060b0 tempest-CreateVolumesFromImageTest-1546470760 None] Deleted volume successfully. Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cfa1edd1-4233-4dfe-aabe-a678fc9c4777 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "cinder-quobyte-676ec336-c9df-4136-839c-65966496dfa9" acquired by "delete_volume" :: waited 0.026s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5051e6f-58ef-4cf8-b16e-fbb2e9557626]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cfa1edd1-4233-4dfe-aabe-a678fc9c4777 tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-676ec336-c9df-4136-839c-65966496dfa9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:24 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ef090578-e40e-4748-9ad0-5272a16060b0 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "cinder-0652dd8e-2024-4ab1-a435-963bd650af6d-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-587cd10a-917e-4a4e-9f78-17821b7fad1c" returned: 0 in 0.296s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.462s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1639329801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f932a4f4-c10c-4d84-94a1-19f3cbf18854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86584e66b2b944ba9d609567dd5d3bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:21Z,use_quota=True,user_id='37b402b92b5749c2bc247f4ea7f392ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Creating volume f932a4f4-c10c-4d84-94a1-19f3cbf18854 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:56:24 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f932a4f4-c10c-4d84-94a1-19f3cbf18854 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:24 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f932a4f4-c10c-4d84-94a1-19f3cbf18854 1073741824 Sep 16 17:56:24 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Attempting download of 8b33d6f6-662e-4e95-b315-d45930a2484e ((None, [{'url': 'file:///opt/stack/data/glance/images/8b33d6f6-662e-4e95-b315-d45930a2484e', 'metadata': {}}])) to volume 587cd10a-917e-4a4e-9f78-17821b7fad1c. {{(pid=85899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e77de78-7fcc-433d-aadc-642c332a6a97]: (4, 'raw') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b33d6f6-662e-4e95-b315-d45930a2484e_fpv2e5cs {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:24 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-676ec336-c9df-4136-839c-65966496dfa9 Sep 16 17:56:24 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:24 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b33d6f6-662e-4e95-b315-d45930a2484e_fpv2e5cs Sep 16 17:56:24 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:25 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cfa1edd1-4233-4dfe-aabe-a678fc9c4777 tempest-CreateVolumesFromImageTest-1546470760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-676ec336-c9df-4136-839c-65966496dfa9" returned: 0 in 0.432s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cfa1edd1-4233-4dfe-aabe-a678fc9c4777 tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-676ec336-c9df-4136-839c-65966496dfa9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:25 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-676ec336-c9df-4136-839c-65966496dfa9 Sep 16 17:56:25 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:25 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b33d6f6-662e-4e95-b315-d45930a2484e_fpv2e5cs" returned: 0 in 0.359s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b33d6f6-662e-4e95-b315-d45930a2484e_fpv2e5cs {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:25 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f932a4f4-c10c-4d84-94a1-19f3cbf18854 1073741824" returned: 0 in 0.510s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f932a4f4-c10c-4d84-94a1-19f3cbf18854 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:25 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b33d6f6-662e-4e95-b315-d45930a2484e_fpv2e5cs Sep 16 17:56:25 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:25 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f932a4f4-c10c-4d84-94a1-19f3cbf18854 Sep 16 17:56:25 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:25 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cfa1edd1-4233-4dfe-aabe-a678fc9c4777 tempest-CreateVolumesFromImageTest-1546470760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-676ec336-c9df-4136-839c-65966496dfa9" returned: 0 in 0.313s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cfa1edd1-4233-4dfe-aabe-a678fc9c4777 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "cinder-quobyte-676ec336-c9df-4136-839c-65966496dfa9" released by "delete_volume" :: held 0.807s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-cfa1edd1-4233-4dfe-aabe-a678fc9c4777 tempest-CreateVolumesFromImageTest-1546470760 None] Created reservations ['11a2d41f-121e-457c-bfe6-3509f049a58f', 'c7abdf48-302b-4fd5-a1ea-6d218b01719e', '05fec6da-8779-436a-b9a4-3bd210f775cc', 'bc2853db-7130-4a94-8a2a-33f74e761b9c'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:56:25 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b33d6f6-662e-4e95-b315-d45930a2484e_fpv2e5cs" returned: 1 in 0.372s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b33d6f6-662e-4e95-b315-d45930a2484e_fpv2e5cs' failed. Not Retrying. {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb346136-6672-4bb7-94bd-5c7e358b13b4]: (4, 'raw') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:25 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f932a4f4-c10c-4d84-94a1-19f3cbf18854" returned: 0 in 0.299s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.946s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-21568095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de38df12-604f-4a27-92d8-7f556fa4b730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86584e66b2b944ba9d609567dd5d3bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:21Z,use_quota=True,user_id='37b402b92b5749c2bc247f4ea7f392ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Creating volume de38df12-604f-4a27-92d8-7f556fa4b730 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:56:25 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de38df12-604f-4a27-92d8-7f556fa4b730 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7cd145f-1be2-4a67-8131-eea10f06f7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f932a4f4-c10c-4d84-94a1-19f3cbf18854', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:25 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de38df12-604f-4a27-92d8-7f556fa4b730 1073741824 Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41c1c9ea-e784-44cd-a585-77e5115d6b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:25 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:25 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Volume volume-f932a4f4-c10c-4d84-94a1-19f3cbf18854 (f932a4f4-c10c-4d84-94a1-19f3cbf18854): created successfully Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41c1c9ea-e784-44cd-a585-77e5115d6b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Flow 'volume_create_manager' (ef8e0848-ed39-4baa-a8fb-807d1a006ab9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cfa1edd1-4233-4dfe-aabe-a678fc9c4777 tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cfa1edd1-4233-4dfe-aabe-a678fc9c4777 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cfa1edd1-4233-4dfe-aabe-a678fc9c4777 tempest-CreateVolumesFromImageTest-1546470760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:25 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD Sep 16 17:56:25 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cfa1edd1-4233-4dfe-aabe-a678fc9c4777 tempest-CreateVolumesFromImageTest-1546470760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cfa1edd1-4233-4dfe-aabe-a678fc9c4777 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cfa1edd1-4233-4dfe-aabe-a678fc9c4777 tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:25 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-eb3d733f-99bf-4cba-ab66-457c8a85d4a8 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Created volume successfully. Sep 16 17:56:25 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:56:25 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5da1c5e2-df0c-4402-9089-2be0b2bc60f7 tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "cinder-bb46864c-85ec-4ca4-a087-40b0e7fb6e88-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5da1c5e2-df0c-4402-9089-2be0b2bc60f7 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "cinder-bb46864c-85ec-4ca4-a087-40b0e7fb6e88-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5da1c5e2-df0c-4402-9089-2be0b2bc60f7 tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "cinder-quobyte-bb46864c-85ec-4ca4-a087-40b0e7fb6e88" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5da1c5e2-df0c-4402-9089-2be0b2bc60f7 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "cinder-quobyte-bb46864c-85ec-4ca4-a087-40b0e7fb6e88" acquired by "delete_volume" :: waited 0.023s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa671e7-8673-4cad-802c-b785b0893703]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:25 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5da1c5e2-df0c-4402-9089-2be0b2bc60f7 tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb46864c-85ec-4ca4-a087-40b0e7fb6e88 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:26 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cfa1edd1-4233-4dfe-aabe-a678fc9c4777 tempest-CreateVolumesFromImageTest-1546470760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.384s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-cfa1edd1-4233-4dfe-aabe-a678fc9c4777 tempest-CreateVolumesFromImageTest-1546470760 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:56:26 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-cfa1edd1-4233-4dfe-aabe-a678fc9c4777 tempest-CreateVolumesFromImageTest-1546470760 None] Deleted volume successfully. Sep 16 17:56:26 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb46864c-85ec-4ca4-a087-40b0e7fb6e88 Sep 16 17:56:26 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cfa1edd1-4233-4dfe-aabe-a678fc9c4777 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "cinder-676ec336-c9df-4136-839c-65966496dfa9-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:26 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD Sep 16 17:56:26 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:26 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de38df12-604f-4a27-92d8-7f556fa4b730 1073741824" returned: 0 in 0.624s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de38df12-604f-4a27-92d8-7f556fa4b730 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:26 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de38df12-604f-4a27-92d8-7f556fa4b730 Sep 16 17:56:26 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:26 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD" returned: 1 in 0.427s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] 8b33d6f6-662e-4e95-b315-d45930a2484e was raw, converting to qcow2 {{(pid=85899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-587cd10a-917e-4a4e-9f78-17821b7fad1c {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:26 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:26 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-587cd10a-917e-4a4e-9f78-17821b7fad1c Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5da1c5e2-df0c-4402-9089-2be0b2bc60f7 tempest-CreateVolumesFromImageTest-1546470760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb46864c-85ec-4ca4-a087-40b0e7fb6e88" returned: 0 in 0.504s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:26 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5da1c5e2-df0c-4402-9089-2be0b2bc60f7 tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb46864c-85ec-4ca4-a087-40b0e7fb6e88 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:26 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb46864c-85ec-4ca4-a087-40b0e7fb6e88 Sep 16 17:56:26 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:26 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de38df12-604f-4a27-92d8-7f556fa4b730" returned: 0 in 0.374s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.628s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2087797624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0340d399-f350-432d-953f-8c522b9d99ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86584e66b2b944ba9d609567dd5d3bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:22Z,use_quota=True,user_id='37b402b92b5749c2bc247f4ea7f392ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Creating volume 0340d399-f350-432d-953f-8c522b9d99ec {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:56:26 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0340d399-f350-432d-953f-8c522b9d99ec 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd7c07c-e807-4b66-95dd-a4d907feb828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de38df12-604f-4a27-92d8-7f556fa4b730', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:26 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0340d399-f350-432d-953f-8c522b9d99ec 1073741824 Sep 16 17:56:26 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17880e14-2d24-468b-8582-0d507c4c714a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:26 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Volume volume-de38df12-604f-4a27-92d8-7f556fa4b730 (de38df12-604f-4a27-92d8-7f556fa4b730): created successfully Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17880e14-2d24-468b-8582-0d507c4c714a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Flow 'volume_create_manager' (46d127d5-a64e-4a6c-80dd-b16d7e92918b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:26 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-cc68dccc-0017-4022-9eb5-c66763b402ee tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Created volume successfully. Sep 16 17:56:26 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5da1c5e2-df0c-4402-9089-2be0b2bc60f7 tempest-CreateVolumesFromImageTest-1546470760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-bb46864c-85ec-4ca4-a087-40b0e7fb6e88" returned: 0 in 0.375s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5da1c5e2-df0c-4402-9089-2be0b2bc60f7 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "cinder-quobyte-bb46864c-85ec-4ca4-a087-40b0e7fb6e88" released by "delete_volume" :: held 0.946s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:26 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-5da1c5e2-df0c-4402-9089-2be0b2bc60f7 tempest-CreateVolumesFromImageTest-1546470760 None] Created reservations ['7a8585b9-78f4-499d-80e2-c5475990222e', 'c82bbe63-da7d-4ae2-8b3a-a9ec9e2b28d4', 'c62ac847-1457-4472-bd18-af7b0b172370', '09d36097-f80e-4bae-9fa4-d7ba882410b4'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:56:27 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-587cd10a-917e-4a4e-9f78-17821b7fad1c" returned: 0 in 0.663s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8b33d6f6-662e-4e95-b315-d45930a2484e_j3i96b6qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-587cd10a-917e-4a4e-9f78-17821b7fad1c {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:56:27 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Converted 0.00 MB image at 0.00 MB/s Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-587cd10a-917e-4a4e-9f78-17821b7fad1c 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5da1c5e2-df0c-4402-9089-2be0b2bc60f7 tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5da1c5e2-df0c-4402-9089-2be0b2bc60f7 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5da1c5e2-df0c-4402-9089-2be0b2bc60f7 tempest-CreateVolumesFromImageTest-1546470760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:27 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-587cd10a-917e-4a4e-9f78-17821b7fad1c 1G Sep 16 17:56:27 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5da1c5e2-df0c-4402-9089-2be0b2bc60f7 tempest-CreateVolumesFromImageTest-1546470760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5da1c5e2-df0c-4402-9089-2be0b2bc60f7 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5da1c5e2-df0c-4402-9089-2be0b2bc60f7 tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:27 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:56:27 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:27 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0340d399-f350-432d-953f-8c522b9d99ec 1073741824" returned: 0 in 0.645s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0340d399-f350-432d-953f-8c522b9d99ec {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:27 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0340d399-f350-432d-953f-8c522b9d99ec Sep 16 17:56:27 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:27 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5da1c5e2-df0c-4402-9089-2be0b2bc60f7 tempest-CreateVolumesFromImageTest-1546470760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.320s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-5da1c5e2-df0c-4402-9089-2be0b2bc60f7 tempest-CreateVolumesFromImageTest-1546470760 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:56:27 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5da1c5e2-df0c-4402-9089-2be0b2bc60f7 tempest-CreateVolumesFromImageTest-1546470760 None] Deleted volume successfully. Sep 16 17:56:27 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-587cd10a-917e-4a4e-9f78-17821b7fad1c 1G" returned: 0 in 0.408s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Downloaded image 8b33d6f6-662e-4e95-b315-d45930a2484e ((None, [{'url': 'file:///opt/stack/data/glance/images/8b33d6f6-662e-4e95-b315-d45930a2484e', 'metadata': {}}])) to volume 587cd10a-917e-4a4e-9f78-17821b7fad1c successfully. {{(pid=85899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Temporary image 8b33d6f6-662e-4e95-b315-d45930a2484e for user 0f8448274c7740ef8ec403b1cf9995b0 is deleted. {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Marking volume 587cd10a-917e-4a4e-9f78-17821b7fad1c as bootable. {{(pid=85899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5da1c5e2-df0c-4402-9089-2be0b2bc60f7 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "cinder-bb46864c-85ec-4ca4-a087-40b0e7fb6e88-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Copying metadata from image 8b33d6f6-662e-4e95-b315-d45930a2484e to 587cd10a-917e-4a4e-9f78-17821b7fad1c. {{(pid=85899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Creating volume glance metadata for volume 587cd10a-917e-4a4e-9f78-17821b7fad1c backed by image 8b33d6f6-662e-4e95-b315-d45930a2484e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '8b33d6f6-662e-4e95-b315-d45930a2484e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f2a8c117c0783ceb0d01f34d285dcc15', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6749e203-91be-4d34-8eef-457e66e82e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-587cd10a-917e-4a4e-9f78-17821b7fad1c', 'volume_size': 1, 'image_id': '8b33d6f6-662e-4e95-b315-d45930a2484e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b33d6f6-662e-4e95-b315-d45930a2484e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f2a8c117c0783ceb0d01f34d285dcc15', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8ab0e5f6b454426590dfc9d7495c098c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd8f73de8181a0ae327d2aae6115fb8034a7839e594a6a221d04eb86d2d0f3e0e15681123f4e0dfd17ebe4bc07da4f6938438adce614652370fdda02e7d18a7b0', 'id': '8b33d6f6-662e-4e95-b315-d45930a2484e', 'created_at': datetime.datetime(2026, 9, 16, 15, 56, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 56, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b33d6f6-662e-4e95-b315-d45930a2484e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d607aa8e-cb13-4968-b329-c935e06d8131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:27 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Volume volume-587cd10a-917e-4a4e-9f78-17821b7fad1c (587cd10a-917e-4a4e-9f78-17821b7fad1c): created successfully Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d607aa8e-cb13-4968-b329-c935e06d8131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Flow 'volume_create_manager' (e8877181-b42d-4997-af15-c28ac24a8c96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:27 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-00b560b3-0070-43e7-b569-70a42a8c3dcc tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Created volume successfully. Sep 16 17:56:27 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0340d399-f350-432d-953f-8c522b9d99ec" returned: 0 in 0.312s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e7814399-e0e9-48d8-b0bb-7035e34945e4 tempest-CinderUnicodeTest-1867908558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.745s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f28b3ff-6d75-4b12-8282-3bee725fbf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0340d399-f350-432d-953f-8c522b9d99ec', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae03e4a-bc23-4304-90d2-497edaa6978b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-e7814399-e0e9-48d8-b0bb-7035e34945e4 tempest-CinderUnicodeTest-1867908558 None] Creating offline snapshot e6657835-b8d2-43fa-9785-fff56e53b05d of volume 79dba313-89cf-41e4-8aff-51b2c994b537 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:56:27 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Volume volume-0340d399-f350-432d-953f-8c522b9d99ec (0340d399-f350-432d-953f-8c522b9d99ec): created successfully Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae03e4a-bc23-4304-90d2-497edaa6978b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Flow 'volume_create_manager' (af5d59d7-5bc0-492e-8789-b8dad2adc3cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b02dfc-8f51-4c27-beb2-8867f08089a1]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e7814399-e0e9-48d8-b0bb-7035e34945e4 tempest-CinderUnicodeTest-1867908558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:27 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-3d11eb01-c4ff-4053-b742-7488842adf0b tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Created volume successfully. Sep 16 17:56:27 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537 Sep 16 17:56:27 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-900cfe40-10ea-4f2f-b966-a002f85e30d8 tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "cinder-2dc5d876-33a6-4b58-940b-47804e97800d-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:27 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-900cfe40-10ea-4f2f-b966-a002f85e30d8 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "cinder-2dc5d876-33a6-4b58-940b-47804e97800d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-900cfe40-10ea-4f2f-b966-a002f85e30d8 tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "cinder-quobyte-2dc5d876-33a6-4b58-940b-47804e97800d" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-900cfe40-10ea-4f2f-b966-a002f85e30d8 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "cinder-quobyte-2dc5d876-33a6-4b58-940b-47804e97800d" acquired by "delete_volume" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:28 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e7814399-e0e9-48d8-b0bb-7035e34945e4 tempest-CinderUnicodeTest-1867908558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537" returned: 0 in 0.400s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e7814399-e0e9-48d8-b0bb-7035e34945e4 tempest-CinderUnicodeTest-1867908558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.e6657835-b8d2-43fa-9785-fff56e53b05d 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4daba7-3e49-48f9-9de6-1a689586b4b4]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-900cfe40-10ea-4f2f-b966-a002f85e30d8 tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2dc5d876-33a6-4b58-940b-47804e97800d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:28 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.e6657835-b8d2-43fa-9785-fff56e53b05d 1G Sep 16 17:56:28 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:28 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2dc5d876-33a6-4b58-940b-47804e97800d Sep 16 17:56:28 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4787857e-2008-480c-bba5-5f0ead78c814 tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Acquiring lock "cinder-587cd10a-917e-4a4e-9f78-17821b7fad1c-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4787857e-2008-480c-bba5-5f0ead78c814 tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Lock "cinder-587cd10a-917e-4a4e-9f78-17821b7fad1c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4787857e-2008-480c-bba5-5f0ead78c814 tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Acquiring lock "cinder-quobyte-587cd10a-917e-4a4e-9f78-17821b7fad1c" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4787857e-2008-480c-bba5-5f0ead78c814 tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Lock "cinder-quobyte-587cd10a-917e-4a4e-9f78-17821b7fad1c" acquired by "delete_volume" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff6f9af-39f8-4fe5-a1ed-757818a1bf30]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4787857e-2008-480c-bba5-5f0ead78c814 tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-587cd10a-917e-4a4e-9f78-17821b7fad1c {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:28 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-900cfe40-10ea-4f2f-b966-a002f85e30d8 tempest-CreateVolumesFromImageTest-1546470760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2dc5d876-33a6-4b58-940b-47804e97800d" returned: 0 in 0.425s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-900cfe40-10ea-4f2f-b966-a002f85e30d8 tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2dc5d876-33a6-4b58-940b-47804e97800d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:28 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2dc5d876-33a6-4b58-940b-47804e97800d Sep 16 17:56:28 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:28 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e7814399-e0e9-48d8-b0bb-7035e34945e4 tempest-CinderUnicodeTest-1867908558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.e6657835-b8d2-43fa-9785-fff56e53b05d 1G" returned: 0 in 0.499s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e7814399-e0e9-48d8-b0bb-7035e34945e4 tempest-CinderUnicodeTest-1867908558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79dba313-89cf-41e4-8aff-51b2c994b537 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.e6657835-b8d2-43fa-9785-fff56e53b05d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:28 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-587cd10a-917e-4a4e-9f78-17821b7fad1c Sep 16 17:56:28 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:28 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79dba313-89cf-41e4-8aff-51b2c994b537 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.e6657835-b8d2-43fa-9785-fff56e53b05d Sep 16 17:56:28 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d226b0f9-fd2f-4dd5-97a3-8b6aa04e3cec tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "cinder-0340d399-f350-432d-953f-8c522b9d99ec-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d226b0f9-fd2f-4dd5-97a3-8b6aa04e3cec tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-0340d399-f350-432d-953f-8c522b9d99ec-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d226b0f9-fd2f-4dd5-97a3-8b6aa04e3cec tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "cinder-quobyte-0340d399-f350-432d-953f-8c522b9d99ec" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d226b0f9-fd2f-4dd5-97a3-8b6aa04e3cec tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-quobyte-0340d399-f350-432d-953f-8c522b9d99ec" acquired by "delete_volume" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df0b53f-5cfc-4279-92cb-b201d28215f4]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d226b0f9-fd2f-4dd5-97a3-8b6aa04e3cec tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0340d399-f350-432d-953f-8c522b9d99ec {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:28 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-900cfe40-10ea-4f2f-b966-a002f85e30d8 tempest-CreateVolumesFromImageTest-1546470760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2dc5d876-33a6-4b58-940b-47804e97800d" returned: 0 in 0.332s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-900cfe40-10ea-4f2f-b966-a002f85e30d8 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "cinder-quobyte-2dc5d876-33a6-4b58-940b-47804e97800d" released by "delete_volume" :: held 0.822s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-900cfe40-10ea-4f2f-b966-a002f85e30d8 tempest-CreateVolumesFromImageTest-1546470760 None] Created reservations ['f1864192-01db-4d0c-ae07-19e78d38a32f', 'cc8d2a03-9957-4aff-9393-5bc2454eef5d', '802ceacb-02d3-4396-8cda-d6384dad1472', 'ff2ff9cb-8a57-4626-b2eb-e527faac78cc'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:56:28 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0340d399-f350-432d-953f-8c522b9d99ec Sep 16 17:56:28 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:28 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4787857e-2008-480c-bba5-5f0ead78c814 tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-587cd10a-917e-4a4e-9f78-17821b7fad1c" returned: 0 in 0.489s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4787857e-2008-480c-bba5-5f0ead78c814 tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-587cd10a-917e-4a4e-9f78-17821b7fad1c {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:29 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-587cd10a-917e-4a4e-9f78-17821b7fad1c Sep 16 17:56:29 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-900cfe40-10ea-4f2f-b966-a002f85e30d8 tempest-CreateVolumesFromImageTest-1546470760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-900cfe40-10ea-4f2f-b966-a002f85e30d8 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-900cfe40-10ea-4f2f-b966-a002f85e30d8 tempest-CreateVolumesFromImageTest-1546470760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:29 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-900cfe40-10ea-4f2f-b966-a002f85e30d8 tempest-CreateVolumesFromImageTest-1546470760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-900cfe40-10ea-4f2f-b966-a002f85e30d8 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-900cfe40-10ea-4f2f-b966-a002f85e30d8 tempest-CreateVolumesFromImageTest-1546470760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e7814399-e0e9-48d8-b0bb-7035e34945e4 tempest-CinderUnicodeTest-1867908558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79dba313-89cf-41e4-8aff-51b2c994b537 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.e6657835-b8d2-43fa-9785-fff56e53b05d" returned: 0 in 0.486s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:29 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-e7814399-e0e9-48d8-b0bb-7035e34945e4 tempest-CinderUnicodeTest-1867908558 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.e6657835-b8d2-43fa-9785-fff56e53b05d is being set with open permissions: ugo+rw Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e7814399-e0e9-48d8-b0bb-7035e34945e4 tempest-CinderUnicodeTest-1867908558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.e6657835-b8d2-43fa-9785-fff56e53b05d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:29 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:56:29 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:29 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.e6657835-b8d2-43fa-9785-fff56e53b05d Sep 16 17:56:29 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:29 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d226b0f9-fd2f-4dd5-97a3-8b6aa04e3cec tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0340d399-f350-432d-953f-8c522b9d99ec" returned: 0 in 0.516s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d226b0f9-fd2f-4dd5-97a3-8b6aa04e3cec tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0340d399-f350-432d-953f-8c522b9d99ec {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:29 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4787857e-2008-480c-bba5-5f0ead78c814 tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-587cd10a-917e-4a4e-9f78-17821b7fad1c" returned: 0 in 0.401s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:29 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0340d399-f350-432d-953f-8c522b9d99ec Sep 16 17:56:29 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4787857e-2008-480c-bba5-5f0ead78c814 tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Lock "cinder-quobyte-587cd10a-917e-4a4e-9f78-17821b7fad1c" released by "delete_volume" :: held 0.942s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:29 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e7814399-e0e9-48d8-b0bb-7035e34945e4 tempest-CinderUnicodeTest-1867908558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.e6657835-b8d2-43fa-9785-fff56e53b05d" returned: 0 in 0.359s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:29 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-900cfe40-10ea-4f2f-b966-a002f85e30d8 tempest-CreateVolumesFromImageTest-1546470760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.402s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-900cfe40-10ea-4f2f-b966-a002f85e30d8 tempest-CreateVolumesFromImageTest-1546470760 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:56:29 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-900cfe40-10ea-4f2f-b966-a002f85e30d8 tempest-CreateVolumesFromImageTest-1546470760 None] Deleted volume successfully. Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e7814399-e0e9-48d8-b0bb-7035e34945e4 tempest-CinderUnicodeTest-1867908558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:29 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.info Sep 16 17:56:29 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-900cfe40-10ea-4f2f-b966-a002f85e30d8 tempest-CreateVolumesFromImageTest-1546470760 None] Lock "cinder-2dc5d876-33a6-4b58-940b-47804e97800d-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-4787857e-2008-480c-bba5-5f0ead78c814 tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Created reservations ['7ca6a860-4f1c-40fa-ba1b-f34ad1f7530b', '8db97f9e-b0c9-4d2b-bfc3-9b907075e767', '070bc0c3-90a3-4b2d-9137-b012907677ae', 'b0c498df-d05c-443e-b67b-6d01deb4ee2c'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4787857e-2008-480c-bba5-5f0ead78c814 tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4787857e-2008-480c-bba5-5f0ead78c814 tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-4787857e-2008-480c-bba5-5f0ead78c814 tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-4787857e-2008-480c-bba5-5f0ead78c814 tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-4787857e-2008-480c-bba5-5f0ead78c814 tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4787857e-2008-480c-bba5-5f0ead78c814 tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:29 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:56:29 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:29 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d226b0f9-fd2f-4dd5-97a3-8b6aa04e3cec tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0340d399-f350-432d-953f-8c522b9d99ec" returned: 0 in 0.372s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d226b0f9-fd2f-4dd5-97a3-8b6aa04e3cec tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-quobyte-0340d399-f350-432d-953f-8c522b9d99ec" released by "delete_volume" :: held 0.963s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-d226b0f9-fd2f-4dd5-97a3-8b6aa04e3cec tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Created reservations ['310d53f2-1dd0-4442-87a7-fd4d1d72908d', '0912af7f-cadb-405d-af10-54c3f32f452e', 'af831826-8a10-4983-9048-79ae01d36cbb', '07049aa7-fb83-4751-98ff-9d41d2dacf93'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:56:29 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e7814399-e0e9-48d8-b0bb-7035e34945e4 tempest-CinderUnicodeTest-1867908558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.info" returned: 0 in 0.400s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:29 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-e7814399-e0e9-48d8-b0bb-7035e34945e4 tempest-CinderUnicodeTest-1867908558 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.info is being set with open permissions: ugo+rw Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e7814399-e0e9-48d8-b0bb-7035e34945e4 tempest-CinderUnicodeTest-1867908558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:29 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.info Sep 16 17:56:29 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d226b0f9-fd2f-4dd5-97a3-8b6aa04e3cec tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d226b0f9-fd2f-4dd5-97a3-8b6aa04e3cec tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d226b0f9-fd2f-4dd5-97a3-8b6aa04e3cec tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d226b0f9-fd2f-4dd5-97a3-8b6aa04e3cec tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d226b0f9-fd2f-4dd5-97a3-8b6aa04e3cec tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d226b0f9-fd2f-4dd5-97a3-8b6aa04e3cec tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:29 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:56:29 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:29 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-4787857e-2008-480c-bba5-5f0ead78c814 tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.316s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:29 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-4787857e-2008-480c-bba5-5f0ead78c814 tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:56:29 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-4787857e-2008-480c-bba5-5f0ead78c814 tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Deleted volume successfully. Sep 16 17:56:30 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-4787857e-2008-480c-bba5-5f0ead78c814 tempest-VolumeAndVolumeTypeFromImageTest-2124365707 None] Lock "cinder-587cd10a-917e-4a4e-9f78-17821b7fad1c-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:30 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d226b0f9-fd2f-4dd5-97a3-8b6aa04e3cec tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.265s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:30 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-d226b0f9-fd2f-4dd5-97a3-8b6aa04e3cec tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:56:30 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-d226b0f9-fd2f-4dd5-97a3-8b6aa04e3cec tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Deleted volume successfully. Sep 16 17:56:30 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:30 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d226b0f9-fd2f-4dd5-97a3-8b6aa04e3cec tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-0340d399-f350-432d-953f-8c522b9d99ec-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e7814399-e0e9-48d8-b0bb-7035e34945e4 tempest-CinderUnicodeTest-1867908558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.info" returned: 0 in 0.359s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e7814399-e0e9-48d8-b0bb-7035e34945e4 tempest-CinderUnicodeTest-1867908558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.653s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:30 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-e7814399-e0e9-48d8-b0bb-7035e34945e4 tempest-CinderUnicodeTest-1867908558 None] Create snapshot completed successfully Sep 16 17:56:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2b3387bb-5c59-488f-ad9b-f74535f3081c tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "cinder-de38df12-604f-4a27-92d8-7f556fa4b730-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2b3387bb-5c59-488f-ad9b-f74535f3081c tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-de38df12-604f-4a27-92d8-7f556fa4b730-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2b3387bb-5c59-488f-ad9b-f74535f3081c tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "cinder-quobyte-de38df12-604f-4a27-92d8-7f556fa4b730" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2b3387bb-5c59-488f-ad9b-f74535f3081c tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-quobyte-de38df12-604f-4a27-92d8-7f556fa4b730" acquired by "delete_volume" :: waited 0.026s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:31 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a74229c-bf12-40f0-bfd6-7721fa187608]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2b3387bb-5c59-488f-ad9b-f74535f3081c tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de38df12-604f-4a27-92d8-7f556fa4b730 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:31 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de38df12-604f-4a27-92d8-7f556fa4b730 Sep 16 17:56:31 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-aba0b3ba-8a02-4693-96bd-23cfe191937a tempest-CinderUnicodeTest-1867908558 None] Acquiring lock "cinder-e6657835-b8d2-43fa-9785-fff56e53b05d-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-aba0b3ba-8a02-4693-96bd-23cfe191937a tempest-CinderUnicodeTest-1867908558 None] Lock "cinder-e6657835-b8d2-43fa-9785-fff56e53b05d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-aba0b3ba-8a02-4693-96bd-23cfe191937a tempest-CinderUnicodeTest-1867908558 None] Acquiring lock "cinder-quobyte-79dba313-89cf-41e4-8aff-51b2c994b537" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-aba0b3ba-8a02-4693-96bd-23cfe191937a tempest-CinderUnicodeTest-1867908558 None] Lock "cinder-quobyte-79dba313-89cf-41e4-8aff-51b2c994b537" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-aba0b3ba-8a02-4693-96bd-23cfe191937a tempest-CinderUnicodeTest-1867908558 None] Acquiring lock "cinder-quobyte-e6657835-b8d2-43fa-9785-fff56e53b05d" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-aba0b3ba-8a02-4693-96bd-23cfe191937a tempest-CinderUnicodeTest-1867908558 None] Lock "cinder-quobyte-e6657835-b8d2-43fa-9785-fff56e53b05d" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:31 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-aba0b3ba-8a02-4693-96bd-23cfe191937a tempest-CinderUnicodeTest-1867908558 None] Deleting offline snapshot e6657835-b8d2-43fa-9785-fff56e53b05d of volume 79dba313-89cf-41e4-8aff-51b2c994b537 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:56:31 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-aba0b3ba-8a02-4693-96bd-23cfe191937a tempest-CinderUnicodeTest-1867908558 None] snapshot_file for this snap is: volume-79dba313-89cf-41e4-8aff-51b2c994b537.e6657835-b8d2-43fa-9785-fff56e53b05d {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:56:31 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[911fd60a-07bd-4b01-b394-8c89a2c71df9]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-aba0b3ba-8a02-4693-96bd-23cfe191937a tempest-CinderUnicodeTest-1867908558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.e6657835-b8d2-43fa-9785-fff56e53b05d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:31 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.e6657835-b8d2-43fa-9785-fff56e53b05d Sep 16 17:56:31 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:31 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2b3387bb-5c59-488f-ad9b-f74535f3081c tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de38df12-604f-4a27-92d8-7f556fa4b730" returned: 0 in 0.510s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2b3387bb-5c59-488f-ad9b-f74535f3081c tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de38df12-604f-4a27-92d8-7f556fa4b730 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:31 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de38df12-604f-4a27-92d8-7f556fa4b730 Sep 16 17:56:31 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:31 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2b3387bb-5c59-488f-ad9b-f74535f3081c tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-de38df12-604f-4a27-92d8-7f556fa4b730" returned: 0 in 0.287s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2b3387bb-5c59-488f-ad9b-f74535f3081c tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-quobyte-de38df12-604f-4a27-92d8-7f556fa4b730" released by "delete_volume" :: held 0.852s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:31 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-aba0b3ba-8a02-4693-96bd-23cfe191937a tempest-CinderUnicodeTest-1867908558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.e6657835-b8d2-43fa-9785-fff56e53b05d" returned: 0 in 0.467s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:31 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-aba0b3ba-8a02-4693-96bd-23cfe191937a tempest-CinderUnicodeTest-1867908558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79dba313-89cf-41e4-8aff-51b2c994b537(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:56:32 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9e488c-b153-4ac2-92ba-bba4684e05f0]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-aba0b3ba-8a02-4693-96bd-23cfe191937a tempest-CinderUnicodeTest-1867908558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:32 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-2b3387bb-5c59-488f-ad9b-f74535f3081c tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Created reservations ['03200905-9490-4e55-8b5e-962b3e6df13d', 'ced05887-2f05-4001-8a6f-5ed6e38409bc', 'fc69793e-54e4-4f6d-9d5a-e187a9488fbb', 'e1bc7490-deb5-4bee-9a6d-43b2c361355d'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:56:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2b3387bb-5c59-488f-ad9b-f74535f3081c tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2b3387bb-5c59-488f-ad9b-f74535f3081c tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2b3387bb-5c59-488f-ad9b-f74535f3081c tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:32 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2b3387bb-5c59-488f-ad9b-f74535f3081c tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2b3387bb-5c59-488f-ad9b-f74535f3081c tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2b3387bb-5c59-488f-ad9b-f74535f3081c tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:32 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537 Sep 16 17:56:32 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:32 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:56:32 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:32 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c6cec34e-7b1c-42cf-9c5e-cf4ab3bb29cd tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "cinder-f932a4f4-c10c-4d84-94a1-19f3cbf18854-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:32 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c6cec34e-7b1c-42cf-9c5e-cf4ab3bb29cd tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-f932a4f4-c10c-4d84-94a1-19f3cbf18854-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:32 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c6cec34e-7b1c-42cf-9c5e-cf4ab3bb29cd tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "cinder-quobyte-f932a4f4-c10c-4d84-94a1-19f3cbf18854" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:32 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c6cec34e-7b1c-42cf-9c5e-cf4ab3bb29cd tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-quobyte-f932a4f4-c10c-4d84-94a1-19f3cbf18854" acquired by "delete_volume" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:32 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba7476c-e83e-4df8-abc8-828abeede913]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c6cec34e-7b1c-42cf-9c5e-cf4ab3bb29cd tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f932a4f4-c10c-4d84-94a1-19f3cbf18854 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:32 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2b3387bb-5c59-488f-ad9b-f74535f3081c tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.369s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:32 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-2b3387bb-5c59-488f-ad9b-f74535f3081c tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:56:32 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-2b3387bb-5c59-488f-ad9b-f74535f3081c tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Deleted volume successfully. Sep 16 17:56:32 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-aba0b3ba-8a02-4693-96bd-23cfe191937a tempest-CinderUnicodeTest-1867908558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537" returned: 0 in 0.539s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-aba0b3ba-8a02-4693-96bd-23cfe191937a tempest-CinderUnicodeTest-1867908558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.e6657835-b8d2-43fa-9785-fff56e53b05d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:32 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-2b3387bb-5c59-488f-ad9b-f74535f3081c tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-de38df12-604f-4a27-92d8-7f556fa4b730-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:32 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.e6657835-b8d2-43fa-9785-fff56e53b05d Sep 16 17:56:32 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f932a4f4-c10c-4d84-94a1-19f3cbf18854 Sep 16 17:56:32 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:32 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:32 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c6cec34e-7b1c-42cf-9c5e-cf4ab3bb29cd tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f932a4f4-c10c-4d84-94a1-19f3cbf18854" returned: 0 in 0.465s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c6cec34e-7b1c-42cf-9c5e-cf4ab3bb29cd tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f932a4f4-c10c-4d84-94a1-19f3cbf18854 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:32 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f932a4f4-c10c-4d84-94a1-19f3cbf18854 Sep 16 17:56:32 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:33 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-aba0b3ba-8a02-4693-96bd-23cfe191937a tempest-CinderUnicodeTest-1867908558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.e6657835-b8d2-43fa-9785-fff56e53b05d" returned: 0 in 0.453s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-aba0b3ba-8a02-4693-96bd-23cfe191937a tempest-CinderUnicodeTest-1867908558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.e6657835-b8d2-43fa-9785-fff56e53b05d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:33 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.e6657835-b8d2-43fa-9785-fff56e53b05d Sep 16 17:56:33 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:33 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c6cec34e-7b1c-42cf-9c5e-cf4ab3bb29cd tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-f932a4f4-c10c-4d84-94a1-19f3cbf18854" returned: 0 in 0.382s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c6cec34e-7b1c-42cf-9c5e-cf4ab3bb29cd tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-quobyte-f932a4f4-c10c-4d84-94a1-19f3cbf18854" released by "delete_volume" :: held 0.946s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:33 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-aba0b3ba-8a02-4693-96bd-23cfe191937a tempest-CinderUnicodeTest-1867908558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537.e6657835-b8d2-43fa-9785-fff56e53b05d" returned: 0 in 0.332s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Flow 'volume_create_manager' (9b6ba1af-a08c-423c-9c3d-a344826827ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de738060-30c6-4f15-8c58-7b6f76ac1920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de738060-30c6-4f15-8c58-7b6f76ac1920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1145798148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=362ec939-081a-4d61-8492-01bd00f719e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf46a98ba11470ebbbae09313eab680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:33Z,use_quota=True,user_id='745d8b4c30aa46759977068c6b2121c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb7ce13-f200-493a-9d5c-915ef8422159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb7ce13-f200-493a-9d5c-915ef8422159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3bf2e1-50f4-4737-83d8-88359079612f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3bf2e1-50f4-4737-83d8-88359079612f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '362ec939-081a-4d61-8492-01bd00f719e1', 'volume_name': 'volume-362ec939-081a-4d61-8492-01bd00f719e1', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1aa3b7a-d042-4a1a-8bb3-6b48206b4421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1aa3b7a-d042-4a1a-8bb3-6b48206b4421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fda9c31-66e2-4f4c-9e5a-6c0b9b42f363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:33 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Volume 362ec939-081a-4d61-8492-01bd00f719e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-362ec939-081a-4d61-8492-01bd00f719e1', 'volume_size': 1} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1145798148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=362ec939-081a-4d61-8492-01bd00f719e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf46a98ba11470ebbbae09313eab680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:33Z,use_quota=True,user_id='745d8b4c30aa46759977068c6b2121c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Creating volume 362ec939-081a-4d61-8492-01bd00f719e1 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:56:33 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-aba0b3ba-8a02-4693-96bd-23cfe191937a tempest-CinderUnicodeTest-1867908558 None] Lock "cinder-quobyte-e6657835-b8d2-43fa-9785-fff56e53b05d" released by "_delete_snapshot" :: held 2.073s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:33 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1 1073741824 Sep 16 17:56:33 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-aba0b3ba-8a02-4693-96bd-23cfe191937a tempest-CinderUnicodeTest-1867908558 None] Lock "cinder-quobyte-79dba313-89cf-41e4-8aff-51b2c994b537" released by "delete_snapshot" :: held 2.116s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-c6cec34e-7b1c-42cf-9c5e-cf4ab3bb29cd tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Created reservations ['655b96ea-093c-4b79-89bc-2a26f9963fea', 'ff38dcab-1839-44bb-a88e-9765ebc57747', 'a497b253-19a7-4c08-8165-8195e263b0d5', '2b2e6cfd-d1f0-4730-b504-5b1871c9b722'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-aba0b3ba-8a02-4693-96bd-23cfe191937a tempest-CinderUnicodeTest-1867908558 None] Created reservations ['8dee9e0b-3963-4d11-9f2b-cc2e71b689da', 'd4d584e4-4c31-47c6-9ea2-08ccb9e10290', '8a66747f-aff9-47cc-861e-60e2e73c6518', '257fbc7a-07be-4d4e-b5cd-e67e01dfbbc3'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c6cec34e-7b1c-42cf-9c5e-cf4ab3bb29cd tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c6cec34e-7b1c-42cf-9c5e-cf4ab3bb29cd tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c6cec34e-7b1c-42cf-9c5e-cf4ab3bb29cd tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c6cec34e-7b1c-42cf-9c5e-cf4ab3bb29cd tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c6cec34e-7b1c-42cf-9c5e-cf4ab3bb29cd tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c6cec34e-7b1c-42cf-9c5e-cf4ab3bb29cd tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:33 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:56:33 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:33 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-aba0b3ba-8a02-4693-96bd-23cfe191937a tempest-CinderUnicodeTest-1867908558 None] Delete snapshot completed successfully. Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-aba0b3ba-8a02-4693-96bd-23cfe191937a tempest-CinderUnicodeTest-1867908558 None] Lock "cinder-e6657835-b8d2-43fa-9785-fff56e53b05d-delete_snapshot" released by "delete_snapshot" :: held 2.350s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:33 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c6cec34e-7b1c-42cf-9c5e-cf4ab3bb29cd tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.310s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-c6cec34e-7b1c-42cf-9c5e-cf4ab3bb29cd tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:56:33 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-c6cec34e-7b1c-42cf-9c5e-cf4ab3bb29cd tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Deleted volume successfully. Sep 16 17:56:33 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1 1073741824" returned: 0 in 0.508s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c6cec34e-7b1c-42cf-9c5e-cf4ab3bb29cd tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-f932a4f4-c10c-4d84-94a1-19f3cbf18854-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:34 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1 Sep 16 17:56:34 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:34 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1" returned: 0 in 0.279s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:56:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fda9c31-66e2-4f4c-9e5a-6c0b9b42f363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-362ec939-081a-4d61-8492-01bd00f719e1', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee07d97-67b9-4a13-b4b3-1d3ec5155ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:34 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Volume volume-362ec939-081a-4d61-8492-01bd00f719e1 (362ec939-081a-4d61-8492-01bd00f719e1): created successfully Sep 16 17:56:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee07d97-67b9-4a13-b4b3-1d3ec5155ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:34 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Flow 'volume_create_manager' (9b6ba1af-a08c-423c-9c3d-a344826827ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:34 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-ddb43a3c-66fe-4ec5-aa85-a5e342b8b8fa tempest-CreateVolumesFromSnapshotTest-1511236129 None] Created volume successfully. Sep 16 17:56:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-780f4041-1e5f-4630-a575-7363ba49b394 tempest-CinderUnicodeTest-1867908558 None] Acquiring lock "cinder-79dba313-89cf-41e4-8aff-51b2c994b537-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-353f3201-cd7f-404d-9caf-0afb3e287006 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "cinder-7865407d-b0d7-471a-bbc4-5e4b7191998a-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-780f4041-1e5f-4630-a575-7363ba49b394 tempest-CinderUnicodeTest-1867908558 None] Lock "cinder-79dba313-89cf-41e4-8aff-51b2c994b537-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-353f3201-cd7f-404d-9caf-0afb3e287006 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-7865407d-b0d7-471a-bbc4-5e4b7191998a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-780f4041-1e5f-4630-a575-7363ba49b394 tempest-CinderUnicodeTest-1867908558 None] Acquiring lock "cinder-quobyte-79dba313-89cf-41e4-8aff-51b2c994b537" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-353f3201-cd7f-404d-9caf-0afb3e287006 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "cinder-quobyte-7865407d-b0d7-471a-bbc4-5e4b7191998a" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-780f4041-1e5f-4630-a575-7363ba49b394 tempest-CinderUnicodeTest-1867908558 None] Lock "cinder-quobyte-79dba313-89cf-41e4-8aff-51b2c994b537" acquired by "delete_volume" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-353f3201-cd7f-404d-9caf-0afb3e287006 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-quobyte-7865407d-b0d7-471a-bbc4-5e4b7191998a" acquired by "delete_volume" :: waited 0.047s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:34 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bab4cc-5625-45a7-becf-78d5b976deba]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-780f4041-1e5f-4630-a575-7363ba49b394 tempest-CinderUnicodeTest-1867908558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:34 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88de5f8-4672-4f4b-b350-cb881255bfcd]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-353f3201-cd7f-404d-9caf-0afb3e287006 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7865407d-b0d7-471a-bbc4-5e4b7191998a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:34 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537 Sep 16 17:56:34 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:34 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7865407d-b0d7-471a-bbc4-5e4b7191998a Sep 16 17:56:34 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:35 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-780f4041-1e5f-4630-a575-7363ba49b394 tempest-CinderUnicodeTest-1867908558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537" returned: 0 in 0.384s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-780f4041-1e5f-4630-a575-7363ba49b394 tempest-CinderUnicodeTest-1867908558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:35 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-353f3201-cd7f-404d-9caf-0afb3e287006 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7865407d-b0d7-471a-bbc4-5e4b7191998a" returned: 0 in 0.387s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-353f3201-cd7f-404d-9caf-0afb3e287006 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7865407d-b0d7-471a-bbc4-5e4b7191998a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:35 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537 Sep 16 17:56:35 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:35 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7865407d-b0d7-471a-bbc4-5e4b7191998a Sep 16 17:56:35 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:35 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-780f4041-1e5f-4630-a575-7363ba49b394 tempest-CinderUnicodeTest-1867908558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-79dba313-89cf-41e4-8aff-51b2c994b537" returned: 0 in 0.299s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-780f4041-1e5f-4630-a575-7363ba49b394 tempest-CinderUnicodeTest-1867908558 None] Lock "cinder-quobyte-79dba313-89cf-41e4-8aff-51b2c994b537" released by "delete_volume" :: held 0.770s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:35 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-353f3201-cd7f-404d-9caf-0afb3e287006 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7865407d-b0d7-471a-bbc4-5e4b7191998a" returned: 0 in 0.330s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-353f3201-cd7f-404d-9caf-0afb3e287006 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-quobyte-7865407d-b0d7-471a-bbc4-5e4b7191998a" released by "delete_volume" :: held 0.778s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-780f4041-1e5f-4630-a575-7363ba49b394 tempest-CinderUnicodeTest-1867908558 None] Created reservations ['195bd9be-d18d-49e0-abb0-d952d248a526', 'e35e0150-9323-427c-ae84-96cd2cd914ef', '89c84800-2823-4f60-9317-d58bffcc8c7b', 'e0662b4e-d0f6-476d-bd21-a008b97049b5'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-353f3201-cd7f-404d-9caf-0afb3e287006 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Created reservations ['6952ec93-a90f-4950-a0e0-2970b4fbaf47', '1daf8249-5816-448e-9d8e-b15640766910', 'ba2dba9e-e7fd-4b08-a836-dada870f9ea9', 'cb575750-7bcd-4d3f-af8d-45f3547b883c'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-780f4041-1e5f-4630-a575-7363ba49b394 tempest-CinderUnicodeTest-1867908558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-780f4041-1e5f-4630-a575-7363ba49b394 tempest-CinderUnicodeTest-1867908558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-780f4041-1e5f-4630-a575-7363ba49b394 tempest-CinderUnicodeTest-1867908558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-780f4041-1e5f-4630-a575-7363ba49b394 tempest-CinderUnicodeTest-1867908558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-780f4041-1e5f-4630-a575-7363ba49b394 tempest-CinderUnicodeTest-1867908558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-780f4041-1e5f-4630-a575-7363ba49b394 tempest-CinderUnicodeTest-1867908558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:35 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:56:35 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-353f3201-cd7f-404d-9caf-0afb3e287006 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-353f3201-cd7f-404d-9caf-0afb3e287006 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-353f3201-cd7f-404d-9caf-0afb3e287006 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-353f3201-cd7f-404d-9caf-0afb3e287006 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-353f3201-cd7f-404d-9caf-0afb3e287006 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-353f3201-cd7f-404d-9caf-0afb3e287006 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6dc6485c-eded-4907-b3c1-f328e6807513 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6dc6485c-eded-4907-b3c1-f328e6807513 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:35 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:56:35 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-6dc6485c-eded-4907-b3c1-f328e6807513 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Creating offline snapshot fb396720-2009-499f-b0d8-4194cbf76f1a of volume 362ec939-081a-4d61-8492-01bd00f719e1 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cfbcc87a-7f17-4d89-a0ba-ba64b70f8d01 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "cinder-ed65d3b2-5a44-4b00-860f-cdc8bb44c07f-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a81930-be61-4190-b48a-e8e4f5bd2a89]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6dc6485c-eded-4907-b3c1-f328e6807513 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cfbcc87a-7f17-4d89-a0ba-ba64b70f8d01 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-ed65d3b2-5a44-4b00-860f-cdc8bb44c07f-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:35 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e7c738b9-1775-4344-9325-69bd92f04796 tempest-CinderUnicodeTest-1867908558 None] Acquiring lock "cinder-54be48e1-cd21-4eed-bdce-e494faff2fed-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e7c738b9-1775-4344-9325-69bd92f04796 tempest-CinderUnicodeTest-1867908558 None] Lock "cinder-54be48e1-cd21-4eed-bdce-e494faff2fed-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cfbcc87a-7f17-4d89-a0ba-ba64b70f8d01 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "cinder-quobyte-ed65d3b2-5a44-4b00-860f-cdc8bb44c07f" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cfbcc87a-7f17-4d89-a0ba-ba64b70f8d01 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-quobyte-ed65d3b2-5a44-4b00-860f-cdc8bb44c07f" acquired by "delete_volume" :: waited 0.047s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:36 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1 Sep 16 17:56:36 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:36 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:36 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-353f3201-cd7f-404d-9caf-0afb3e287006 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.361s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-780f4041-1e5f-4630-a575-7363ba49b394 tempest-CinderUnicodeTest-1867908558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.416s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-353f3201-cd7f-404d-9caf-0afb3e287006 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-780f4041-1e5f-4630-a575-7363ba49b394 tempest-CinderUnicodeTest-1867908558 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8fdec0-512b-4692-a34f-46a3771e958a]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cfbcc87a-7f17-4d89-a0ba-ba64b70f8d01 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ed65d3b2-5a44-4b00-860f-cdc8bb44c07f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e7c738b9-1775-4344-9325-69bd92f04796 tempest-CinderUnicodeTest-1867908558 None] Acquiring lock "cinder-quobyte-54be48e1-cd21-4eed-bdce-e494faff2fed" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:36 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-353f3201-cd7f-404d-9caf-0afb3e287006 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Deleted volume successfully. Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e7c738b9-1775-4344-9325-69bd92f04796 tempest-CinderUnicodeTest-1867908558 None] Lock "cinder-quobyte-54be48e1-cd21-4eed-bdce-e494faff2fed" acquired by "delete_volume" :: waited 0.039s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:36 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-780f4041-1e5f-4630-a575-7363ba49b394 tempest-CinderUnicodeTest-1867908558 None] Deleted volume successfully. Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-353f3201-cd7f-404d-9caf-0afb3e287006 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-7865407d-b0d7-471a-bbc4-5e4b7191998a-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4fda85-bbe9-4d51-80a6-bc71c802a718]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e7c738b9-1775-4344-9325-69bd92f04796 tempest-CinderUnicodeTest-1867908558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-54be48e1-cd21-4eed-bdce-e494faff2fed {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-780f4041-1e5f-4630-a575-7363ba49b394 tempest-CinderUnicodeTest-1867908558 None] Lock "cinder-79dba313-89cf-41e4-8aff-51b2c994b537-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:36 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ed65d3b2-5a44-4b00-860f-cdc8bb44c07f Sep 16 17:56:36 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:36 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-54be48e1-cd21-4eed-bdce-e494faff2fed Sep 16 17:56:36 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:36 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6dc6485c-eded-4907-b3c1-f328e6807513 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1" returned: 0 in 0.581s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6dc6485c-eded-4907-b3c1-f328e6807513 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.fb396720-2009-499f-b0d8-4194cbf76f1a 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:36 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.fb396720-2009-499f-b0d8-4194cbf76f1a 1G Sep 16 17:56:36 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:36 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cfbcc87a-7f17-4d89-a0ba-ba64b70f8d01 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ed65d3b2-5a44-4b00-860f-cdc8bb44c07f" returned: 0 in 0.579s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cfbcc87a-7f17-4d89-a0ba-ba64b70f8d01 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ed65d3b2-5a44-4b00-860f-cdc8bb44c07f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:36 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ed65d3b2-5a44-4b00-860f-cdc8bb44c07f Sep 16 17:56:36 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:36 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e7c738b9-1775-4344-9325-69bd92f04796 tempest-CinderUnicodeTest-1867908558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-54be48e1-cd21-4eed-bdce-e494faff2fed" returned: 0 in 0.566s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e7c738b9-1775-4344-9325-69bd92f04796 tempest-CinderUnicodeTest-1867908558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-54be48e1-cd21-4eed-bdce-e494faff2fed {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:36 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-54be48e1-cd21-4eed-bdce-e494faff2fed Sep 16 17:56:36 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Flow 'volume_create_manager' (c4fd3ac5-2a9d-4289-b933-6938f5189da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021daa6e-6676-4856-8386-97116cf7ef46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021daa6e-6676-4856-8386-97116cf7ef46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1270103066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d1926ff-1b90-4dbd-b01f-630dc628d754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f61508a475834a5fbda4e08ee0b9f4d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:37Z,use_quota=True,user_id='741d9296ad5b4c9bacd02168f5f280a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9251a549-cd52-46d4-8e0f-3ce8815a77b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9251a549-cd52-46d4-8e0f-3ce8815a77b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8535234a-c76a-4878-9774-99d224c74d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8535234a-c76a-4878-9774-99d224c74d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d1926ff-1b90-4dbd-b01f-630dc628d754', 'volume_name': 'volume-1d1926ff-1b90-4dbd-b01f-630dc628d754', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0880ea0a-0c90-4db0-ae5b-9ebe68a9acd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0880ea0a-0c90-4db0-ae5b-9ebe68a9acd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4d2976-e7c8-4e1a-b619-54cbc5894438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:37 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Volume 1d1926ff-1b90-4dbd-b01f-630dc628d754: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d1926ff-1b90-4dbd-b01f-630dc628d754', 'volume_size': 1} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:37 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6dc6485c-eded-4907-b3c1-f328e6807513 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.fb396720-2009-499f-b0d8-4194cbf76f1a 1G" returned: 0 in 0.579s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6dc6485c-eded-4907-b3c1-f328e6807513 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-362ec939-081a-4d61-8492-01bd00f719e1 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.fb396720-2009-499f-b0d8-4194cbf76f1a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:37 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cfbcc87a-7f17-4d89-a0ba-ba64b70f8d01 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ed65d3b2-5a44-4b00-860f-cdc8bb44c07f" returned: 0 in 0.342s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:37 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-362ec939-081a-4d61-8492-01bd00f719e1 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.fb396720-2009-499f-b0d8-4194cbf76f1a Sep 16 17:56:37 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cfbcc87a-7f17-4d89-a0ba-ba64b70f8d01 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-quobyte-ed65d3b2-5a44-4b00-860f-cdc8bb44c07f" released by "delete_volume" :: held 1.014s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-cfbcc87a-7f17-4d89-a0ba-ba64b70f8d01 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Created reservations ['caa259b5-9dc2-4681-b041-d74e3abb4fc0', '291c5b04-0299-49c9-8e72-555ffffc3870', '6dbb9a11-8b87-4f82-950a-3d7c91015bbb', '98577fa2-3f32-4c5b-8bdf-b27fcec45098'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:56:37 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e7c738b9-1775-4344-9325-69bd92f04796 tempest-CinderUnicodeTest-1867908558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-54be48e1-cd21-4eed-bdce-e494faff2fed" returned: 0 in 0.328s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e7c738b9-1775-4344-9325-69bd92f04796 tempest-CinderUnicodeTest-1867908558 None] Lock "cinder-quobyte-54be48e1-cd21-4eed-bdce-e494faff2fed" released by "delete_volume" :: held 0.988s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cfbcc87a-7f17-4d89-a0ba-ba64b70f8d01 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cfbcc87a-7f17-4d89-a0ba-ba64b70f8d01 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cfbcc87a-7f17-4d89-a0ba-ba64b70f8d01 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-cfbcc87a-7f17-4d89-a0ba-ba64b70f8d01 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-cfbcc87a-7f17-4d89-a0ba-ba64b70f8d01 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cfbcc87a-7f17-4d89-a0ba-ba64b70f8d01 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-e7c738b9-1775-4344-9325-69bd92f04796 tempest-CinderUnicodeTest-1867908558 None] Created reservations ['e5fc7a54-9017-4fbc-a851-ed76f77a8442', '3e2f1ca3-6e63-456c-986e-6b6c9cefd186', '8067df7e-d960-424f-a0ed-51d89452405b', '227d4359-c8fc-4816-a171-0ce66324f3c7'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:56:37 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:56:37 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:37 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6dc6485c-eded-4907-b3c1-f328e6807513 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-362ec939-081a-4d61-8492-01bd00f719e1 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.fb396720-2009-499f-b0d8-4194cbf76f1a" returned: 0 in 0.355s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:37 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-6dc6485c-eded-4907-b3c1-f328e6807513 tempest-CreateVolumesFromSnapshotTest-1511236129 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.fb396720-2009-499f-b0d8-4194cbf76f1a is being set with open permissions: ugo+rw Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6dc6485c-eded-4907-b3c1-f328e6807513 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.fb396720-2009-499f-b0d8-4194cbf76f1a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e7c738b9-1775-4344-9325-69bd92f04796 tempest-CinderUnicodeTest-1867908558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e7c738b9-1775-4344-9325-69bd92f04796 tempest-CinderUnicodeTest-1867908558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e7c738b9-1775-4344-9325-69bd92f04796 tempest-CinderUnicodeTest-1867908558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e7c738b9-1775-4344-9325-69bd92f04796 tempest-CinderUnicodeTest-1867908558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e7c738b9-1775-4344-9325-69bd92f04796 tempest-CinderUnicodeTest-1867908558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e7c738b9-1775-4344-9325-69bd92f04796 tempest-CinderUnicodeTest-1867908558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:37 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.fb396720-2009-499f-b0d8-4194cbf76f1a Sep 16 17:56:37 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:37 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:56:37 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:37 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-cfbcc87a-7f17-4d89-a0ba-ba64b70f8d01 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.313s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-cfbcc87a-7f17-4d89-a0ba-ba64b70f8d01 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:56:37 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-cfbcc87a-7f17-4d89-a0ba-ba64b70f8d01 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Deleted volume successfully. Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-cfbcc87a-7f17-4d89-a0ba-ba64b70f8d01 tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-ed65d3b2-5a44-4b00-860f-cdc8bb44c07f-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:37 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6dc6485c-eded-4907-b3c1-f328e6807513 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.fb396720-2009-499f-b0d8-4194cbf76f1a" returned: 0 in 0.257s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:37 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e7c738b9-1775-4344-9325-69bd92f04796 tempest-CinderUnicodeTest-1867908558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.254s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-e7c738b9-1775-4344-9325-69bd92f04796 tempest-CinderUnicodeTest-1867908558 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:56:37 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-e7c738b9-1775-4344-9325-69bd92f04796 tempest-CinderUnicodeTest-1867908558 None] Deleted volume successfully. Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6dc6485c-eded-4907-b3c1-f328e6807513 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:37 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.info Sep 16 17:56:37 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e7c738b9-1775-4344-9325-69bd92f04796 tempest-CinderUnicodeTest-1867908558 None] Lock "cinder-54be48e1-cd21-4eed-bdce-e494faff2fed-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:37 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6dc6485c-eded-4907-b3c1-f328e6807513 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.info" returned: 0 in 0.244s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:37 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-6dc6485c-eded-4907-b3c1-f328e6807513 tempest-CreateVolumesFromSnapshotTest-1511236129 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.info is being set with open permissions: ugo+rw Sep 16 17:56:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6dc6485c-eded-4907-b3c1-f328e6807513 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:37 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.info Sep 16 17:56:37 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:38 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ccc2e3c5-2b4f-4f39-840f-74ea5e74e7cb tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "cinder-b585a614-9371-4139-b4ee-58d6691636aa-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6dc6485c-eded-4907-b3c1-f328e6807513 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.info" returned: 0 in 0.273s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6dc6485c-eded-4907-b3c1-f328e6807513 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.465s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.272s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1270103066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d1926ff-1b90-4dbd-b01f-630dc628d754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f61508a475834a5fbda4e08ee0b9f4d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:37Z,use_quota=True,user_id='741d9296ad5b4c9bacd02168f5f280a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:56:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Creating volume 1d1926ff-1b90-4dbd-b01f-630dc628d754 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:56:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:56:38 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:56:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:38 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754 1073741824 Sep 16 17:56:38 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ccc2e3c5-2b4f-4f39-840f-74ea5e74e7cb tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-b585a614-9371-4139-b4ee-58d6691636aa-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:38 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-6dc6485c-eded-4907-b3c1-f328e6807513 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Create snapshot completed successfully Sep 16 17:56:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ccc2e3c5-2b4f-4f39-840f-74ea5e74e7cb tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "cinder-quobyte-b585a614-9371-4139-b4ee-58d6691636aa" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ccc2e3c5-2b4f-4f39-840f-74ea5e74e7cb tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-quobyte-b585a614-9371-4139-b4ee-58d6691636aa" acquired by "delete_volume" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:38 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9288154-5e0e-4c84-80ee-70ea999768c3]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ccc2e3c5-2b4f-4f39-840f-74ea5e74e7cb tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b585a614-9371-4139-b4ee-58d6691636aa {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:38 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b585a614-9371-4139-b4ee-58d6691636aa Sep 16 17:56:38 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:38 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754 1073741824" returned: 0 in 0.467s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:38 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ccc2e3c5-2b4f-4f39-840f-74ea5e74e7cb tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b585a614-9371-4139-b4ee-58d6691636aa" returned: 0 in 0.381s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ccc2e3c5-2b4f-4f39-840f-74ea5e74e7cb tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b585a614-9371-4139-b4ee-58d6691636aa {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:38 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b585a614-9371-4139-b4ee-58d6691636aa Sep 16 17:56:38 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:38 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754 Sep 16 17:56:38 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:39 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:39 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ccc2e3c5-2b4f-4f39-840f-74ea5e74e7cb tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b585a614-9371-4139-b4ee-58d6691636aa" returned: 0 in 0.313s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754" returned: 0 in 0.302s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4d2976-e7c8-4e1a-b619-54cbc5894438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d1926ff-1b90-4dbd-b01f-630dc628d754', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d495e2d0-745f-43c9-a1ed-0a720789f964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ccc2e3c5-2b4f-4f39-840f-74ea5e74e7cb tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-quobyte-b585a614-9371-4139-b4ee-58d6691636aa" released by "delete_volume" :: held 0.778s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:39 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Volume volume-1d1926ff-1b90-4dbd-b01f-630dc628d754 (1d1926ff-1b90-4dbd-b01f-630dc628d754): created successfully Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d495e2d0-745f-43c9-a1ed-0a720789f964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Flow 'volume_create_manager' (c4fd3ac5-2a9d-4289-b933-6938f5189da2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:39 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5afc08ef-6ff5-470a-a180-b2fdd78ef6b2 tempest-VolumeDependencyTests-1408803358 None] Created volume successfully. Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-ccc2e3c5-2b4f-4f39-840f-74ea5e74e7cb tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Created reservations ['166684b2-0246-4fae-8812-275658d7bb8f', 'e773151c-6546-4255-b5e5-ae3c2f4e511f', '2e088971-9a93-46b3-85c4-a940e3acf495', 'aec0dd51-3786-4be4-b370-97238b152b09'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ccc2e3c5-2b4f-4f39-840f-74ea5e74e7cb tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ccc2e3c5-2b4f-4f39-840f-74ea5e74e7cb tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ccc2e3c5-2b4f-4f39-840f-74ea5e74e7cb tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ccc2e3c5-2b4f-4f39-840f-74ea5e74e7cb tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ccc2e3c5-2b4f-4f39-840f-74ea5e74e7cb tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ccc2e3c5-2b4f-4f39-840f-74ea5e74e7cb tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:39 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:56:39 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Flow 'volume_create_manager' (5417c05e-359a-4007-a1f2-799e18c3a281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0c6913-4c3a-443e-9034-77a41d43d07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0c6913-4c3a-443e-9034-77a41d43d07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-582209473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=476eb87e-ac64-4feb-b338-0de92b374dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf46a98ba11470ebbbae09313eab680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:40Z,use_quota=True,user_id='745d8b4c30aa46759977068c6b2121c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a0b064-77cc-4e6f-8de3-24c3a2dd785b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a0b064-77cc-4e6f-8de3-24c3a2dd785b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02cd6aeb-2ae6-4f5d-989d-259b33f18fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02cd6aeb-2ae6-4f5d-989d-259b33f18fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '476eb87e-ac64-4feb-b338-0de92b374dae', 'volume_name': 'volume-476eb87e-ac64-4feb-b338-0de92b374dae', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b039ff-66dd-4f1b-882d-6549056b2437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b039ff-66dd-4f1b-882d-6549056b2437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2547875e-0c4c-499b-9df6-c379249237dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:39 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Volume 476eb87e-ac64-4feb-b338-0de92b374dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-476eb87e-ac64-4feb-b338-0de92b374dae', 'volume_size': 1} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-582209473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=476eb87e-ac64-4feb-b338-0de92b374dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf46a98ba11470ebbbae09313eab680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:40Z,use_quota=True,user_id='745d8b4c30aa46759977068c6b2121c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Creating volume 476eb87e-ac64-4feb-b338-0de92b374dae {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:56:39 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476eb87e-ac64-4feb-b338-0de92b374dae 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:39 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:39 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476eb87e-ac64-4feb-b338-0de92b374dae 1073741824 Sep 16 17:56:39 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ccc2e3c5-2b4f-4f39-840f-74ea5e74e7cb tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.367s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-ccc2e3c5-2b4f-4f39-840f-74ea5e74e7cb tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:56:39 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-ccc2e3c5-2b4f-4f39-840f-74ea5e74e7cb tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Deleted volume successfully. Sep 16 17:56:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-ccc2e3c5-2b4f-4f39-840f-74ea5e74e7cb tempest-CreateVolumesFromSourceVolumeTest-2047834241 None] Lock "cinder-b585a614-9371-4139-b4ee-58d6691636aa-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Flow 'volume_create_manager' (c10c507d-b066-41db-876d-e34b25876376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d43f645-c07b-489d-96f3-37cebee551e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d43f645-c07b-489d-96f3-37cebee551e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-743594662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd5bd1fb-031f-4965-bedd-8c6c17f193a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf46a98ba11470ebbbae09313eab680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:40Z,use_quota=True,user_id='745d8b4c30aa46759977068c6b2121c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791420b9-e155-4b92-8f40-51284bd221b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791420b9-e155-4b92-8f40-51284bd221b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6aa7d60-72d3-49c7-89c6-14f842539173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6aa7d60-72d3-49c7-89c6-14f842539173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd5bd1fb-031f-4965-bedd-8c6c17f193a2', 'volume_name': 'volume-fd5bd1fb-031f-4965-bedd-8c6c17f193a2', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327546ab-4a5f-42de-909e-251ed11c3dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327546ab-4a5f-42de-909e-251ed11c3dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e16c59e-e2eb-408b-85a9-574b8220c82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:40 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Volume fd5bd1fb-031f-4965-bedd-8c6c17f193a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd5bd1fb-031f-4965-bedd-8c6c17f193a2', 'volume_size': 1} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:40 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476eb87e-ac64-4feb-b338-0de92b374dae 1073741824" returned: 0 in 0.744s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476eb87e-ac64-4feb-b338-0de92b374dae {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:40 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476eb87e-ac64-4feb-b338-0de92b374dae Sep 16 17:56:40 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-88a101cd-549f-4081-b0f3-1c4964eb8596 tempest-VolumeDependencyTests-1408803358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Flow 'volume_create_manager' (28000ba6-c7a4-4e17-a202-8b0727793d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ad51da-3255-4a4d-a3b7-9e53e3947bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:40 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476eb87e-ac64-4feb-b338-0de92b374dae" returned: 0 in 0.357s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.569s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-743594662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd5bd1fb-031f-4965-bedd-8c6c17f193a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf46a98ba11470ebbbae09313eab680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:40Z,use_quota=True,user_id='745d8b4c30aa46759977068c6b2121c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Creating volume fd5bd1fb-031f-4965-bedd-8c6c17f193a2 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:56:40 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fd5bd1fb-031f-4965-bedd-8c6c17f193a2 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ad51da-3255-4a4d-a3b7-9e53e3947bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-490810117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a65b8ce-472a-40d7-8ab0-d256f9c3e1de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf46a98ba11470ebbbae09313eab680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:41Z,use_quota=True,user_id='745d8b4c30aa46759977068c6b2121c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a2cfe4-8ffe-40bb-b847-31cafcf95c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a2cfe4-8ffe-40bb-b847-31cafcf95c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:40 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fd5bd1fb-031f-4965-bedd-8c6c17f193a2 1073741824 Sep 16 17:56:40 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:41 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a75007-6a99-4c4a-b0ec-2e8322882b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:41 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a75007-6a99-4c4a-b0ec-2e8322882b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a65b8ce-472a-40d7-8ab0-d256f9c3e1de', 'volume_name': 'volume-0a65b8ce-472a-40d7-8ab0-d256f9c3e1de', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:41 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5497a61-2eee-47d2-8a4d-d44148d9d6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:41 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5497a61-2eee-47d2-8a4d-d44148d9d6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:41 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f45051-945f-4f15-8cfe-8b8992887472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:41 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Volume 0a65b8ce-472a-40d7-8ab0-d256f9c3e1de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a65b8ce-472a-40d7-8ab0-d256f9c3e1de', 'volume_size': 1} Sep 16 17:56:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:41 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2547875e-0c4c-499b-9df6-c379249237dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-476eb87e-ac64-4feb-b338-0de92b374dae', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:41 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487da81f-3ea1-4641-90f8-9424502fe72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:41 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Volume volume-476eb87e-ac64-4feb-b338-0de92b374dae (476eb87e-ac64-4feb-b338-0de92b374dae): created successfully Sep 16 17:56:41 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487da81f-3ea1-4641-90f8-9424502fe72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:41 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Flow 'volume_create_manager' (5417c05e-359a-4007-a1f2-799e18c3a281) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:41 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-9d0eec40-3ad5-4860-bae4-015d92d7d079 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Created volume successfully. Sep 16 17:56:41 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fd5bd1fb-031f-4965-bedd-8c6c17f193a2 1073741824" returned: 0 in 0.775s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fd5bd1fb-031f-4965-bedd-8c6c17f193a2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:41 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fd5bd1fb-031f-4965-bedd-8c6c17f193a2 Sep 16 17:56:41 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:41 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:56:41 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Flow 'volume_create_manager' (7e7693e4-4481-473f-a34a-dda02b86ea40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:41 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d92d2f6-451d-4307-8739-4e8f885cbdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:41 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d92d2f6-451d-4307-8739-4e8f885cbdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-920197187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d31bd668-b682-4cf4-9376-f250e8d478c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf46a98ba11470ebbbae09313eab680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:42Z,use_quota=True,user_id='745d8b4c30aa46759977068c6b2121c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:41 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f8dd5fd-ef3b-4c48-9f91-22900bfbe120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:41 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f8dd5fd-ef3b-4c48-9f91-22900bfbe120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:41 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf606b5-3194-412c-948a-b92965b8d9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:41 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf606b5-3194-412c-948a-b92965b8d9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd31bd668-b682-4cf4-9376-f250e8d478c0', 'volume_name': 'volume-d31bd668-b682-4cf4-9376-f250e8d478c0', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54da808-77dc-4502-9645-b30e725b3735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54da808-77dc-4502-9645-b30e725b3735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86c7d65-445b-4c8f-9e1c-df49b724818e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:42 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Volume d31bd668-b682-4cf4-9376-f250e8d478c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d31bd668-b682-4cf4-9376-f250e8d478c0', 'volume_size': 1} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:42 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fd5bd1fb-031f-4965-bedd-8c6c17f193a2" returned: 0 in 0.410s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-88a101cd-549f-4081-b0f3-1c4964eb8596 tempest-VolumeDependencyTests-1408803358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.350s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e16c59e-e2eb-408b-85a9-574b8220c82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd5bd1fb-031f-4965-bedd-8c6c17f193a2', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (950110e1-cd4b-4b34-8f18-b0a1979f501e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-88a101cd-549f-4081-b0f3-1c4964eb8596 tempest-VolumeDependencyTests-1408803358 None] Creating offline snapshot 26caeb34-f1a6-497f-b1c0-0e7a5ec0e650 of volume 1d1926ff-1b90-4dbd-b01f-630dc628d754 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:56:42 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Volume volume-fd5bd1fb-031f-4965-bedd-8c6c17f193a2 (fd5bd1fb-031f-4965-bedd-8c6c17f193a2): created successfully Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (950110e1-cd4b-4b34-8f18-b0a1979f501e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Flow 'volume_create_manager' (c10c507d-b066-41db-876d-e34b25876376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf5f55f-22d8-4a9a-a50d-e9622600d300]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-88a101cd-549f-4081-b0f3-1c4964eb8596 tempest-VolumeDependencyTests-1408803358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Flow 'volume_create_manager' (a6e47443-9936-4fa0-b631-9e7d5045289f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4121500d-7771-4bd1-adf1-965926ee8e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:42 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-08f1b3fe-3cc5-46fc-848b-3cf5a7d8f999 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Created volume successfully. Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4121500d-7771-4bd1-adf1-965926ee8e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-260132586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a768864-ba82-4a1b-88af-23fca34427e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf46a98ba11470ebbbae09313eab680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:42Z,use_quota=True,user_id='745d8b4c30aa46759977068c6b2121c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06986160-e751-485d-af3f-ee040b5de847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06986160-e751-485d-af3f-ee040b5de847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c9af0d-b42f-4b4a-b3e9-3cf425b18308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c9af0d-b42f-4b4a-b3e9-3cf425b18308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a768864-ba82-4a1b-88af-23fca34427e9', 'volume_name': 'volume-3a768864-ba82-4a1b-88af-23fca34427e9', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c89b805f-40ec-4c27-b3a1-7d0bce84ccb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c89b805f-40ec-4c27-b3a1-7d0bce84ccb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746b4a60-fa1e-41bb-9ea7-5394cd22f70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:42 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Volume 3a768864-ba82-4a1b-88af-23fca34427e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a768864-ba82-4a1b-88af-23fca34427e9', 'volume_size': 1} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:42 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754 Sep 16 17:56:42 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:42 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-88a101cd-549f-4081-b0f3-1c4964eb8596 tempest-VolumeDependencyTests-1408803358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754" returned: 0 in 0.467s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-88a101cd-549f-4081-b0f3-1c4964eb8596 tempest-VolumeDependencyTests-1408803358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.26caeb34-f1a6-497f-b1c0-0e7a5ec0e650 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:42 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.26caeb34-f1a6-497f-b1c0-0e7a5ec0e650 1G Sep 16 17:56:42 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:43 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-88a101cd-549f-4081-b0f3-1c4964eb8596 tempest-VolumeDependencyTests-1408803358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.26caeb34-f1a6-497f-b1c0-0e7a5ec0e650 1G" returned: 0 in 0.484s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-88a101cd-549f-4081-b0f3-1c4964eb8596 tempest-VolumeDependencyTests-1408803358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d1926ff-1b90-4dbd-b01f-630dc628d754 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.26caeb34-f1a6-497f-b1c0-0e7a5ec0e650 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:43 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d1926ff-1b90-4dbd-b01f-630dc628d754 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.26caeb34-f1a6-497f-b1c0-0e7a5ec0e650 Sep 16 17:56:43 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:43 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-88a101cd-549f-4081-b0f3-1c4964eb8596 tempest-VolumeDependencyTests-1408803358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d1926ff-1b90-4dbd-b01f-630dc628d754 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.26caeb34-f1a6-497f-b1c0-0e7a5ec0e650" returned: 0 in 0.365s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:43 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-88a101cd-549f-4081-b0f3-1c4964eb8596 tempest-VolumeDependencyTests-1408803358 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.26caeb34-f1a6-497f-b1c0-0e7a5ec0e650 is being set with open permissions: ugo+rw Sep 16 17:56:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-88a101cd-549f-4081-b0f3-1c4964eb8596 tempest-VolumeDependencyTests-1408803358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.26caeb34-f1a6-497f-b1c0-0e7a5ec0e650 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:43 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.26caeb34-f1a6-497f-b1c0-0e7a5ec0e650 Sep 16 17:56:43 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:43 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-88a101cd-549f-4081-b0f3-1c4964eb8596 tempest-VolumeDependencyTests-1408803358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.26caeb34-f1a6-497f-b1c0-0e7a5ec0e650" returned: 0 in 0.307s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-88a101cd-549f-4081-b0f3-1c4964eb8596 tempest-VolumeDependencyTests-1408803358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:44 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.info Sep 16 17:56:44 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:44 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-88a101cd-549f-4081-b0f3-1c4964eb8596 tempest-VolumeDependencyTests-1408803358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.info" returned: 0 in 0.265s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:44 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-88a101cd-549f-4081-b0f3-1c4964eb8596 tempest-VolumeDependencyTests-1408803358 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.info is being set with open permissions: ugo+rw Sep 16 17:56:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-88a101cd-549f-4081-b0f3-1c4964eb8596 tempest-VolumeDependencyTests-1408803358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:44 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.info Sep 16 17:56:44 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:44 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-88a101cd-549f-4081-b0f3-1c4964eb8596 tempest-VolumeDependencyTests-1408803358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.info" returned: 0 in 0.267s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-88a101cd-549f-4081-b0f3-1c4964eb8596 tempest-VolumeDependencyTests-1408803358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.323s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.518s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-490810117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a65b8ce-472a-40d7-8ab0-d256f9c3e1de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf46a98ba11470ebbbae09313eab680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:41Z,use_quota=True,user_id='745d8b4c30aa46759977068c6b2121c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:56:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Creating volume 0a65b8ce-472a-40d7-8ab0-d256f9c3e1de {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:56:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:56:44 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:56:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0a65b8ce-472a-40d7-8ab0-d256f9c3e1de 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:44 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0a65b8ce-472a-40d7-8ab0-d256f9c3e1de 1073741824 Sep 16 17:56:44 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:44 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-88a101cd-549f-4081-b0f3-1c4964eb8596 tempest-VolumeDependencyTests-1408803358 None] Create snapshot completed successfully Sep 16 17:56:45 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0a65b8ce-472a-40d7-8ab0-d256f9c3e1de 1073741824" returned: 0 in 0.602s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0a65b8ce-472a-40d7-8ab0-d256f9c3e1de {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:45 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0a65b8ce-472a-40d7-8ab0-d256f9c3e1de Sep 16 17:56:45 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:45 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0a65b8ce-472a-40d7-8ab0-d256f9c3e1de" returned: 0 in 0.364s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.562s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-920197187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d31bd668-b682-4cf4-9376-f250e8d478c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf46a98ba11470ebbbae09313eab680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:42Z,use_quota=True,user_id='745d8b4c30aa46759977068c6b2121c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Creating volume d31bd668-b682-4cf4-9376-f250e8d478c0 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:56:45 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d31bd668-b682-4cf4-9376-f250e8d478c0 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f45051-945f-4f15-8cfe-8b8992887472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a65b8ce-472a-40d7-8ab0-d256f9c3e1de', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:45 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d31bd668-b682-4cf4-9376-f250e8d478c0 1073741824 Sep 16 17:56:45 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dcd4740-1f4e-48bb-94a9-ba20be06dbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:45 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Volume volume-0a65b8ce-472a-40d7-8ab0-d256f9c3e1de (0a65b8ce-472a-40d7-8ab0-d256f9c3e1de): created successfully Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dcd4740-1f4e-48bb-94a9-ba20be06dbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Flow 'volume_create_manager' (28000ba6-c7a4-4e17-a202-8b0727793d3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:45 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-0c9b171e-72d1-49a3-bc5d-446d2438ec18 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Created volume successfully. Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Flow 'volume_create_manager' (c05d3722-486f-4460-bbbc-e5a73bab70cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d4c64a-5dc6-4028-ae5c-8874fdbfa91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d4c64a-5dc6-4028-ae5c-8874fdbfa91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-792321719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07903e78-3310-4d00-88fa-ff6d5e04dc75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f61508a475834a5fbda4e08ee0b9f4d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=26caeb34-f1a6-497f-b1c0-0e7a5ec0e650,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:46Z,use_quota=True,user_id='741d9296ad5b4c9bacd02168f5f280a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f40d134-5c5a-414e-88c7-826a576fcf0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f40d134-5c5a-414e-88c7-826a576fcf0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ea32a6-8b01-4a3b-a179-05be261090d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ea32a6-8b01-4a3b-a179-05be261090d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '07903e78-3310-4d00-88fa-ff6d5e04dc75', 'volume_name': 'volume-07903e78-3310-4d00-88fa-ff6d5e04dc75', 'volume_size': 1, 'snapshot_id': '26caeb34-f1a6-497f-b1c0-0e7a5ec0e650'}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35786044-35a2-4eb2-befd-9e489b8b1e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35786044-35a2-4eb2-befd-9e489b8b1e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e753c35-64a7-486e-84db-222045fcf1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:45 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Volume 07903e78-3310-4d00-88fa-ff6d5e04dc75: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-07903e78-3310-4d00-88fa-ff6d5e04dc75', 'volume_size': 1, 'snapshot_id': '26caeb34-f1a6-497f-b1c0-0e7a5ec0e650'} Sep 16 17:56:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:46 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d31bd668-b682-4cf4-9376-f250e8d478c0 1073741824" returned: 0 in 0.611s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d31bd668-b682-4cf4-9376-f250e8d478c0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:46 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d31bd668-b682-4cf4-9376-f250e8d478c0 Sep 16 17:56:46 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:46 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d31bd668-b682-4cf4-9376-f250e8d478c0" returned: 0 in 0.299s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:56:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.106s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-260132586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a768864-ba82-4a1b-88af-23fca34427e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf46a98ba11470ebbbae09313eab680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:42Z,use_quota=True,user_id='745d8b4c30aa46759977068c6b2121c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:56:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Creating volume 3a768864-ba82-4a1b-88af-23fca34427e9 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:56:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:56:46 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:56:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3a768864-ba82-4a1b-88af-23fca34427e9 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86c7d65-445b-4c8f-9e1c-df49b724818e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d31bd668-b682-4cf4-9376-f250e8d478c0', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c33139-da1d-4599-b359-5fefdfb8b390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:46 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3a768864-ba82-4a1b-88af-23fca34427e9 1073741824 Sep 16 17:56:46 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:46 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Volume volume-d31bd668-b682-4cf4-9376-f250e8d478c0 (d31bd668-b682-4cf4-9376-f250e8d478c0): created successfully Sep 16 17:56:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c33139-da1d-4599-b359-5fefdfb8b390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Flow 'volume_create_manager' (7e7693e4-4481-473f-a34a-dda02b86ea40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:46 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-f6b67502-4571-4c00-aee7-6d7db4063271 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Created volume successfully. Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Flow 'volume_create_manager' (30be67c4-3fbf-480e-8831-b3a540977e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1bb5e8a-1271-4c07-a0b0-ea97546e84d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1bb5e8a-1271-4c07-a0b0-ea97546e84d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d010cdc8-a87a-4198-b018-08394417faec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13e6797a711241b89135542376189a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:47Z,use_quota=True,user_id='88612389361f46b1a04d33c3a9b2e63d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:47 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20efc163-2942-40ec-9e34-69ea2d75803a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20efc163-2942-40ec-9e34-69ea2d75803a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b2180f-c748-43d2-a218-41be0679a9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.image.glance [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Creating Keystone auth plugin from conf {{(pid=85899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3a768864-ba82-4a1b-88af-23fca34427e9 1073741824" returned: 0 in 0.497s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3a768864-ba82-4a1b-88af-23fca34427e9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:47 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3a768864-ba82-4a1b-88af-23fca34427e9 Sep 16 17:56:47 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b2180f-c748-43d2-a218-41be0679a9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd010cdc8-a87a-4198-b018-08394417faec', 'volume_name': 'volume-d010cdc8-a87a-4198-b018-08394417faec', 'volume_size': 1, 'image_id': '2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '77b274c01fa4e30e919bdb48a7fda29b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '13e6797a711241b89135542376189a63', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '92b8e26caf33713774cc18cd02ab935792837db73325f3246fbf0de4f58f5a519a118a656df3d67b5aad9c7e4dad82b77e444c0adc63e5ea39c2a015562f734f', 'id': '2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085', 'created_at': datetime.datetime(2026, 9, 16, 15, 56, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 56, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085/file', 'properties': {}}, 'image_service': }' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22401a02-f242-47fb-ba15-4edaa36e8f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22401a02-f242-47fb-ba15-4edaa36e8f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531615a6-b18f-436c-b605-9f9aaf9b9349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:47 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Volume d010cdc8-a87a-4198-b018-08394417faec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d010cdc8-a87a-4198-b018-08394417faec', 'volume_size': 1, 'image_id': '2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '77b274c01fa4e30e919bdb48a7fda29b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '13e6797a711241b89135542376189a63', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '92b8e26caf33713774cc18cd02ab935792837db73325f3246fbf0de4f58f5a519a118a656df3d67b5aad9c7e4dad82b77e444c0adc63e5ea39c2a015562f734f', 'id': '2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085', 'created_at': datetime.datetime(2026, 9, 16, 15, 56, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 56, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085/file', 'properties': {}}, 'image_service': } Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Trying to clone d010cdc8-a87a-4198-b018-08394417faec from image 2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085', 'metadata': {}}]). {{(pid=85899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 17:56:47 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3a768864-ba82-4a1b-88af-23fca34427e9" returned: 0 in 0.292s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.538s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Acquiring lock "cinder-quobyte-26caeb34-f1a6-497f-b1c0-0e7a5ec0e650-07903e78-3310-4d00-88fa-ff6d5e04dc75" by "_create_volume_from_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746b4a60-fa1e-41bb-9ea7-5394cd22f70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a768864-ba82-4a1b-88af-23fca34427e9', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cae04496-75d7-4d2f-ac0c-7a29ba1215ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Lock "cinder-quobyte-26caeb34-f1a6-497f-b1c0-0e7a5ec0e650-07903e78-3310-4d00-88fa-ff6d5e04dc75" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Creating volume 07903e78-3310-4d00-88fa-ff6d5e04dc75 from snapshot 26caeb34-f1a6-497f-b1c0-0e7a5ec0e650 {{(pid=85899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Acquiring lock "cinder-quobyte-07903e78-3310-4d00-88fa-ff6d5e04dc75" by "_copy_volume_from_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:47 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Volume volume-3a768864-ba82-4a1b-88af-23fca34427e9 (3a768864-ba82-4a1b-88af-23fca34427e9): created successfully Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cae04496-75d7-4d2f-ac0c-7a29ba1215ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Flow 'volume_create_manager' (a6e47443-9936-4fa0-b631-9e7d5045289f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 16 17:56:47 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Image download 0.00 MB at 0.00 MB/s Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Lock "cinder-quobyte-07903e78-3310-4d00-88fa-ff6d5e04dc75" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] snapshot: 26caeb34-f1a6-497f-b1c0-0e7a5ec0e650, volume: 07903e78-3310-4d00-88fa-ff6d5e04dc75, {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:47 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-974fb794-2ee8-4b52-b3cd-ef0c85262511 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Created volume successfully. Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a8b24c-3e1e-495f-9778-6f50c4c9edb1]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.26caeb34-f1a6-497f-b1c0-0e7a5ec0e650 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c2319e-d2f0-48b3-a772-4177a1e56d73]: (4, 'raw') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:47 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.26caeb34-f1a6-497f-b1c0-0e7a5ec0e650 Sep 16 17:56:47 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:47 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD Sep 16 17:56:47 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9a83f054-5ef3-40d1-b193-8809358b5883 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "cinder-3a768864-ba82-4a1b-88af-23fca34427e9-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9a83f054-5ef3-40d1-b193-8809358b5883 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-3a768864-ba82-4a1b-88af-23fca34427e9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:47 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9a83f054-5ef3-40d1-b193-8809358b5883 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "cinder-quobyte-3a768864-ba82-4a1b-88af-23fca34427e9" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9a83f054-5ef3-40d1-b193-8809358b5883 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-quobyte-3a768864-ba82-4a1b-88af-23fca34427e9" acquired by "delete_volume" :: waited 0.022s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:48 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02fa4c6-b690-4caa-a9e8-cc8807df1e65]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9a83f054-5ef3-40d1-b193-8809358b5883 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3a768864-ba82-4a1b-88af-23fca34427e9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:48 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.26caeb34-f1a6-497f-b1c0-0e7a5ec0e650" returned: 0 in 0.494s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d1926ff-1b90-4dbd-b01f-630dc628d754(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aed454-3531-4f2a-a5df-c18e2392a35f]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:48 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD Sep 16 17:56:48 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:48 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3a768864-ba82-4a1b-88af-23fca34427e9 Sep 16 17:56:48 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:48 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754 Sep 16 17:56:48 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:48 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Temporary image 2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085 is fetched for user 88612389361f46b1a04d33c3a9b2e63d. {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 16 17:56:48 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9a83f054-5ef3-40d1-b193-8809358b5883 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3a768864-ba82-4a1b-88af-23fca34427e9" returned: 0 in 0.410s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9a83f054-5ef3-40d1-b193-8809358b5883 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3a768864-ba82-4a1b-88af-23fca34427e9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:48 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3a768864-ba82-4a1b-88af-23fca34427e9 Sep 16 17:56:48 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dbc53f-2492-4d9f-a4a9-8dd7f2f961da]: (4, 'raw') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:48 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754" returned: 0 in 0.474s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754 {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Creating direct copy from snapshot {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG cinder.utils [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Path /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-07903e78-3310-4d00-88fa-ff6d5e04dc75 not found in is_blk_device check {{(pid=85899) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-07903e78-3310-4d00-88fa-ff6d5e04dc75 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:48 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-07903e78-3310-4d00-88fa-ff6d5e04dc75 Sep 16 17:56:48 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:48 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD Sep 16 17:56:48 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:48 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9a83f054-5ef3-40d1-b193-8809358b5883 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-3a768864-ba82-4a1b-88af-23fca34427e9" returned: 0 in 0.294s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9a83f054-5ef3-40d1-b193-8809358b5883 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-quobyte-3a768864-ba82-4a1b-88af-23fca34427e9" released by "delete_volume" :: held 0.764s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-9a83f054-5ef3-40d1-b193-8809358b5883 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Created reservations ['659e3e09-5805-4f8b-83df-be3a987b4ac1', 'd3dd29f4-187a-41bd-96f6-adadcd15a8a8', 'e6cb1a34-83b7-43b5-8182-3b8f348d6463', '09424f90-88cf-49ad-867f-abafd7ffaf01'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:56:48 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9a83f054-5ef3-40d1-b193-8809358b5883 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9a83f054-5ef3-40d1-b193-8809358b5883 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9a83f054-5ef3-40d1-b193-8809358b5883 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9a83f054-5ef3-40d1-b193-8809358b5883 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9a83f054-5ef3-40d1-b193-8809358b5883 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9a83f054-5ef3-40d1-b193-8809358b5883 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:49 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:56:49 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:49 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD Sep 16 17:56:49 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:49 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-40905804-636f-4470-abdf-a2726187a1dc tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "cinder-d31bd668-b682-4cf4-9376-f250e8d478c0-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:49 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-40905804-636f-4470-abdf-a2726187a1dc tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-d31bd668-b682-4cf4-9376-f250e8d478c0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:49 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-40905804-636f-4470-abdf-a2726187a1dc tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "cinder-quobyte-d31bd668-b682-4cf4-9376-f250e8d478c0" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:49 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-40905804-636f-4470-abdf-a2726187a1dc tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-quobyte-d31bd668-b682-4cf4-9376-f250e8d478c0" acquired by "delete_volume" :: waited 0.041s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:49 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44d7d5c-491c-4680-9db0-80cbb655f9a7]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-40905804-636f-4470-abdf-a2726187a1dc tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d31bd668-b682-4cf4-9376-f250e8d478c0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:49 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9a83f054-5ef3-40d1-b193-8809358b5883 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.468s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:49 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-9a83f054-5ef3-40d1-b193-8809358b5883 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:56:49 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-9a83f054-5ef3-40d1-b193-8809358b5883 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Deleted volume successfully. Sep 16 17:56:49 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:49 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9a83f054-5ef3-40d1-b193-8809358b5883 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-3a768864-ba82-4a1b-88af-23fca34427e9-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD" returned: 1 in 0.620s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:56:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:49 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d31bd668-b682-4cf4-9376-f250e8d478c0 Sep 16 17:56:49 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:50 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-40905804-636f-4470-abdf-a2726187a1dc tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d31bd668-b682-4cf4-9376-f250e8d478c0" returned: 0 in 0.766s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-40905804-636f-4470-abdf-a2726187a1dc tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d31bd668-b682-4cf4-9376-f250e8d478c0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:50 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d31bd668-b682-4cf4-9376-f250e8d478c0 Sep 16 17:56:50 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:50 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-40905804-636f-4470-abdf-a2726187a1dc tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d31bd668-b682-4cf4-9376-f250e8d478c0" returned: 0 in 0.552s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-40905804-636f-4470-abdf-a2726187a1dc tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-quobyte-d31bd668-b682-4cf4-9376-f250e8d478c0" released by "delete_volume" :: held 1.430s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:50 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-40905804-636f-4470-abdf-a2726187a1dc tempest-CreateVolumesFromSnapshotTest-1511236129 None] Created reservations ['69e04d0c-128d-42da-956a-c9e402411a55', '6de1ccd9-5630-44bc-81ab-c48d84a34eb4', 'cf63c3fc-f417-4c6a-bca5-6854d8c985ba', 'ddc9526e-879c-4a1e-ba65-c65968fea529'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:56:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-40905804-636f-4470-abdf-a2726187a1dc tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-40905804-636f-4470-abdf-a2726187a1dc tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:50 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-40905804-636f-4470-abdf-a2726187a1dc tempest-CreateVolumesFromSnapshotTest-1511236129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:50 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-40905804-636f-4470-abdf-a2726187a1dc tempest-CreateVolumesFromSnapshotTest-1511236129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-40905804-636f-4470-abdf-a2726187a1dc tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-40905804-636f-4470-abdf-a2726187a1dc tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:51 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:56:51 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:51 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-40905804-636f-4470-abdf-a2726187a1dc tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.396s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:51 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-40905804-636f-4470-abdf-a2726187a1dc tempest-CreateVolumesFromSnapshotTest-1511236129 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:56:51 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-40905804-636f-4470-abdf-a2726187a1dc tempest-CreateVolumesFromSnapshotTest-1511236129 None] Deleted volume successfully. Sep 16 17:56:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-40905804-636f-4470-abdf-a2726187a1dc tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-d31bd668-b682-4cf4-9376-f250e8d478c0-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-32d3094a-a7bf-4983-8ce2-253f1b8c1083 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "cinder-0a65b8ce-472a-40d7-8ab0-d256f9c3e1de-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-32d3094a-a7bf-4983-8ce2-253f1b8c1083 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-0a65b8ce-472a-40d7-8ab0-d256f9c3e1de-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-32d3094a-a7bf-4983-8ce2-253f1b8c1083 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "cinder-quobyte-0a65b8ce-472a-40d7-8ab0-d256f9c3e1de" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-32d3094a-a7bf-4983-8ce2-253f1b8c1083 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-quobyte-0a65b8ce-472a-40d7-8ab0-d256f9c3e1de" acquired by "delete_volume" :: waited 0.025s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:51 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3093ca81-7684-464b-8aca-92fafe2d3118]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-32d3094a-a7bf-4983-8ce2-253f1b8c1083 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0a65b8ce-472a-40d7-8ab0-d256f9c3e1de {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:52 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0a65b8ce-472a-40d7-8ab0-d256f9c3e1de Sep 16 17:56:52 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:52 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-32d3094a-a7bf-4983-8ce2-253f1b8c1083 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0a65b8ce-472a-40d7-8ab0-d256f9c3e1de" returned: 0 in 0.755s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-32d3094a-a7bf-4983-8ce2-253f1b8c1083 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0a65b8ce-472a-40d7-8ab0-d256f9c3e1de {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:52 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0a65b8ce-472a-40d7-8ab0-d256f9c3e1de Sep 16 17:56:52 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:53 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-32d3094a-a7bf-4983-8ce2-253f1b8c1083 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0a65b8ce-472a-40d7-8ab0-d256f9c3e1de" returned: 0 in 0.438s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:53 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-32d3094a-a7bf-4983-8ce2-253f1b8c1083 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-quobyte-0a65b8ce-472a-40d7-8ab0-d256f9c3e1de" released by "delete_volume" :: held 1.318s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:53 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-32d3094a-a7bf-4983-8ce2-253f1b8c1083 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Created reservations ['65f973bc-58a3-4096-9c24-3e77f36d48d7', '9d41c8b4-e1ca-430c-bbe7-0ef940e71231', '7a969910-3b85-4da3-9f28-7df2249a31c1', '7e0b61fb-7145-4213-a29f-3879e318a07e'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:56:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-32d3094a-a7bf-4983-8ce2-253f1b8c1083 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-32d3094a-a7bf-4983-8ce2-253f1b8c1083 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-32d3094a-a7bf-4983-8ce2-253f1b8c1083 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-32d3094a-a7bf-4983-8ce2-253f1b8c1083 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-32d3094a-a7bf-4983-8ce2-253f1b8c1083 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-32d3094a-a7bf-4983-8ce2-253f1b8c1083 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:53 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:56:53 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:54 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-32d3094a-a7bf-4983-8ce2-253f1b8c1083 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.578s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:54 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-32d3094a-a7bf-4983-8ce2-253f1b8c1083 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:56:54 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-32d3094a-a7bf-4983-8ce2-253f1b8c1083 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Deleted volume successfully. Sep 16 17:56:54 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-32d3094a-a7bf-4983-8ce2-253f1b8c1083 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-0a65b8ce-472a-40d7-8ab0-d256f9c3e1de-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:54 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-75f87528-e1d7-4d3b-925b-c66a48a3e3b7 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "cinder-fd5bd1fb-031f-4965-bedd-8c6c17f193a2-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:54 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-75f87528-e1d7-4d3b-925b-c66a48a3e3b7 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-fd5bd1fb-031f-4965-bedd-8c6c17f193a2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:54 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-75f87528-e1d7-4d3b-925b-c66a48a3e3b7 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "cinder-quobyte-fd5bd1fb-031f-4965-bedd-8c6c17f193a2" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:54 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-75f87528-e1d7-4d3b-925b-c66a48a3e3b7 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-quobyte-fd5bd1fb-031f-4965-bedd-8c6c17f193a2" acquired by "delete_volume" :: waited 0.028s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:54 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82cc7c9-c2e5-437f-9bb0-c3a4a2743cb6]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-75f87528-e1d7-4d3b-925b-c66a48a3e3b7 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fd5bd1fb-031f-4965-bedd-8c6c17f193a2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:54 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fd5bd1fb-031f-4965-bedd-8c6c17f193a2 Sep 16 17:56:54 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:55 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-75f87528-e1d7-4d3b-925b-c66a48a3e3b7 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fd5bd1fb-031f-4965-bedd-8c6c17f193a2" returned: 0 in 0.636s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-75f87528-e1d7-4d3b-925b-c66a48a3e3b7 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fd5bd1fb-031f-4965-bedd-8c6c17f193a2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:55 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fd5bd1fb-031f-4965-bedd-8c6c17f193a2 Sep 16 17:56:55 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:55 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-75f87528-e1d7-4d3b-925b-c66a48a3e3b7 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-fd5bd1fb-031f-4965-bedd-8c6c17f193a2" returned: 0 in 0.467s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:55 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-75f87528-e1d7-4d3b-925b-c66a48a3e3b7 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-quobyte-fd5bd1fb-031f-4965-bedd-8c6c17f193a2" released by "delete_volume" :: held 1.233s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:55 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-75f87528-e1d7-4d3b-925b-c66a48a3e3b7 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Created reservations ['bce2b18b-5b13-453a-bece-997e83afb600', '67b5038a-9375-413f-bbbd-39fbb3df81bc', '19609a97-e1e3-40f6-839f-b04c54a13ced', '88075a73-5fe6-472c-8f3c-6a1b7a51b559'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:56:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-75f87528-e1d7-4d3b-925b-c66a48a3e3b7 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-75f87528-e1d7-4d3b-925b-c66a48a3e3b7 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:55 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-75f87528-e1d7-4d3b-925b-c66a48a3e3b7 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:55 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-75f87528-e1d7-4d3b-925b-c66a48a3e3b7 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-75f87528-e1d7-4d3b-925b-c66a48a3e3b7 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-75f87528-e1d7-4d3b-925b-c66a48a3e3b7 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:55 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:56:55 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:56 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-75f87528-e1d7-4d3b-925b-c66a48a3e3b7 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.435s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:56 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-75f87528-e1d7-4d3b-925b-c66a48a3e3b7 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:56:56 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-75f87528-e1d7-4d3b-925b-c66a48a3e3b7 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Deleted volume successfully. Sep 16 17:56:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-75f87528-e1d7-4d3b-925b-c66a48a3e3b7 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-fd5bd1fb-031f-4965-bedd-8c6c17f193a2-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-48dc04d0-1267-4e38-9214-861d2d894f91 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "cinder-476eb87e-ac64-4feb-b338-0de92b374dae-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-48dc04d0-1267-4e38-9214-861d2d894f91 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-476eb87e-ac64-4feb-b338-0de92b374dae-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-48dc04d0-1267-4e38-9214-861d2d894f91 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "cinder-quobyte-476eb87e-ac64-4feb-b338-0de92b374dae" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-48dc04d0-1267-4e38-9214-861d2d894f91 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-quobyte-476eb87e-ac64-4feb-b338-0de92b374dae" acquired by "delete_volume" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:56 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad80acd-944d-46bd-a91c-838b8281f791]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-48dc04d0-1267-4e38-9214-861d2d894f91 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476eb87e-ac64-4feb-b338-0de92b374dae {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:56 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476eb87e-ac64-4feb-b338-0de92b374dae Sep 16 17:56:56 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:57 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-07903e78-3310-4d00-88fa-ff6d5e04dc75" returned: 0 in 8.684s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Image conversion details: src /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754, size 1024.00 MB, duration 8.69 sec, destination /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-07903e78-3310-4d00-88fa-ff6d5e04dc75 {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:56:57 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Converted 1024.00 MB image at 117.88 MB/s Sep 16 17:56:57 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-07903e78-3310-4d00-88fa-ff6d5e04dc75 is being set with open permissions: ugo+rw Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-07903e78-3310-4d00-88fa-ff6d5e04dc75 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:57 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-07903e78-3310-4d00-88fa-ff6d5e04dc75 Sep 16 17:56:57 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:57 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-48dc04d0-1267-4e38-9214-861d2d894f91 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476eb87e-ac64-4feb-b338-0de92b374dae" returned: 0 in 0.553s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-48dc04d0-1267-4e38-9214-861d2d894f91 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476eb87e-ac64-4feb-b338-0de92b374dae {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:57 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476eb87e-ac64-4feb-b338-0de92b374dae Sep 16 17:56:57 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:57 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-07903e78-3310-4d00-88fa-ff6d5e04dc75" returned: 0 in 0.280s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Lock "cinder-quobyte-07903e78-3310-4d00-88fa-ff6d5e04dc75" released by "_copy_volume_from_snapshot" :: held 10.056s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:57 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-48dc04d0-1267-4e38-9214-861d2d894f91 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476eb87e-ac64-4feb-b338-0de92b374dae" returned: 0 in 0.277s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Lock "cinder-quobyte-26caeb34-f1a6-497f-b1c0-0e7a5ec0e650-07903e78-3310-4d00-88fa-ff6d5e04dc75" released by "_create_volume_from_snapshot" :: held 10.166s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.201s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.060s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d010cdc8-a87a-4198-b018-08394417faec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13e6797a711241b89135542376189a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:56:47Z,use_quota=True,user_id='88612389361f46b1a04d33c3a9b2e63d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Creating volume d010cdc8-a87a-4198-b018-08394417faec {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:56:57 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d010cdc8-a87a-4198-b018-08394417faec 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-48dc04d0-1267-4e38-9214-861d2d894f91 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-quobyte-476eb87e-ac64-4feb-b338-0de92b374dae" released by "delete_volume" :: held 0.945s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:57 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d010cdc8-a87a-4198-b018-08394417faec 1073741824 Sep 16 17:56:57 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e753c35-64a7-486e-84db-222045fcf1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07903e78-3310-4d00-88fa-ff6d5e04dc75', 'volume_size': 1, 'snapshot_id': '26caeb34-f1a6-497f-b1c0-0e7a5ec0e650'}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182fad7b-41a8-4e23-9278-f2c5f16a8238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:56:57 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Volume volume-07903e78-3310-4d00-88fa-ff6d5e04dc75 (07903e78-3310-4d00-88fa-ff6d5e04dc75): created successfully Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182fad7b-41a8-4e23-9278-f2c5f16a8238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Flow 'volume_create_manager' (c05d3722-486f-4460-bbbc-e5a73bab70cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:56:57 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-b48c29bd-9894-44a3-9dfd-36787ad6f938 tempest-VolumeDependencyTests-1408803358 None] Created volume successfully. Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-48dc04d0-1267-4e38-9214-861d2d894f91 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Created reservations ['16c6566a-36db-4f83-a5f5-fd901a9c6537', '91b04d32-8bfe-40b6-b7ab-d1f6ab6b41e4', 'e9f6d1e7-da50-4420-a973-298080b45cad', '5b97a882-5660-46b9-8f6d-e6a229bd95f2'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-48dc04d0-1267-4e38-9214-861d2d894f91 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-48dc04d0-1267-4e38-9214-861d2d894f91 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-48dc04d0-1267-4e38-9214-861d2d894f91 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-48dc04d0-1267-4e38-9214-861d2d894f91 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-48dc04d0-1267-4e38-9214-861d2d894f91 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-48dc04d0-1267-4e38-9214-861d2d894f91 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:57 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:56:57 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5d3e47ae-ca68-48f4-9bb3-8cba0c62af3a tempest-VolumeDependencyTests-1408803358 None] Acquiring lock "cinder-26caeb34-f1a6-497f-b1c0-0e7a5ec0e650-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5d3e47ae-ca68-48f4-9bb3-8cba0c62af3a tempest-VolumeDependencyTests-1408803358 None] Lock "cinder-26caeb34-f1a6-497f-b1c0-0e7a5ec0e650-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5d3e47ae-ca68-48f4-9bb3-8cba0c62af3a tempest-VolumeDependencyTests-1408803358 None] Acquiring lock "cinder-quobyte-1d1926ff-1b90-4dbd-b01f-630dc628d754" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5d3e47ae-ca68-48f4-9bb3-8cba0c62af3a tempest-VolumeDependencyTests-1408803358 None] Lock "cinder-quobyte-1d1926ff-1b90-4dbd-b01f-630dc628d754" acquired by "delete_snapshot" :: waited 0.104s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5d3e47ae-ca68-48f4-9bb3-8cba0c62af3a tempest-VolumeDependencyTests-1408803358 None] Acquiring lock "cinder-quobyte-26caeb34-f1a6-497f-b1c0-0e7a5ec0e650" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5d3e47ae-ca68-48f4-9bb3-8cba0c62af3a tempest-VolumeDependencyTests-1408803358 None] Lock "cinder-quobyte-26caeb34-f1a6-497f-b1c0-0e7a5ec0e650" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5d3e47ae-ca68-48f4-9bb3-8cba0c62af3a tempest-VolumeDependencyTests-1408803358 None] Deleting offline snapshot 26caeb34-f1a6-497f-b1c0-0e7a5ec0e650 of volume 1d1926ff-1b90-4dbd-b01f-630dc628d754 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5d3e47ae-ca68-48f4-9bb3-8cba0c62af3a tempest-VolumeDependencyTests-1408803358 None] snapshot_file for this snap is: volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.26caeb34-f1a6-497f-b1c0-0e7a5ec0e650 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1721c3a-0fd1-4d97-8824-762e040ac9ee]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5d3e47ae-ca68-48f4-9bb3-8cba0c62af3a tempest-VolumeDependencyTests-1408803358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.26caeb34-f1a6-497f-b1c0-0e7a5ec0e650 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:58 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d010cdc8-a87a-4198-b018-08394417faec 1073741824" returned: 0 in 0.640s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:58 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-48dc04d0-1267-4e38-9214-861d2d894f91 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.438s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-48dc04d0-1267-4e38-9214-861d2d894f91 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:56:58 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-48dc04d0-1267-4e38-9214-861d2d894f91 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Deleted volume successfully. Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d010cdc8-a87a-4198-b018-08394417faec {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-48dc04d0-1267-4e38-9214-861d2d894f91 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-476eb87e-ac64-4feb-b338-0de92b374dae-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:56:58 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.26caeb34-f1a6-497f-b1c0-0e7a5ec0e650 Sep 16 17:56:58 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:58 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d010cdc8-a87a-4198-b018-08394417faec Sep 16 17:56:58 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:58 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d010cdc8-a87a-4198-b018-08394417faec" returned: 0 in 0.255s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Attempting download of 2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085 ((None, [{'url': 'file:///opt/stack/data/glance/images/2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085', 'metadata': {}}])) to volume d010cdc8-a87a-4198-b018-08394417faec. {{(pid=85899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 17:56:58 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5d3e47ae-ca68-48f4-9bb3-8cba0c62af3a tempest-VolumeDependencyTests-1408803358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.26caeb34-f1a6-497f-b1c0-0e7a5ec0e650" returned: 0 in 0.450s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5d3e47ae-ca68-48f4-9bb3-8cba0c62af3a tempest-VolumeDependencyTests-1408803358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d1926ff-1b90-4dbd-b01f-630dc628d754(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[78087dd3-67c6-4e72-917a-bd51efd43903]: (4, 'raw') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_bekkwoz8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fc2e15-296e-4446-9c55-bcaea89293fd]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5d3e47ae-ca68-48f4-9bb3-8cba0c62af3a tempest-VolumeDependencyTests-1408803358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:58 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_bekkwoz8 Sep 16 17:56:58 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754 Sep 16 17:56:58 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:58 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-250faf52-ad40-46b1-b93d-900a89ca87f1 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "cinder-fb396720-2009-499f-b0d8-4194cbf76f1a-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-250faf52-ad40-46b1-b93d-900a89ca87f1 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-fb396720-2009-499f-b0d8-4194cbf76f1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-250faf52-ad40-46b1-b93d-900a89ca87f1 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "cinder-quobyte-362ec939-081a-4d61-8492-01bd00f719e1" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-250faf52-ad40-46b1-b93d-900a89ca87f1 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-quobyte-362ec939-081a-4d61-8492-01bd00f719e1" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-250faf52-ad40-46b1-b93d-900a89ca87f1 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "cinder-quobyte-fb396720-2009-499f-b0d8-4194cbf76f1a" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-250faf52-ad40-46b1-b93d-900a89ca87f1 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-quobyte-fb396720-2009-499f-b0d8-4194cbf76f1a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-250faf52-ad40-46b1-b93d-900a89ca87f1 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Deleting offline snapshot fb396720-2009-499f-b0d8-4194cbf76f1a of volume 362ec939-081a-4d61-8492-01bd00f719e1 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:56:58 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-250faf52-ad40-46b1-b93d-900a89ca87f1 tempest-CreateVolumesFromSnapshotTest-1511236129 None] snapshot_file for this snap is: volume-362ec939-081a-4d61-8492-01bd00f719e1.fb396720-2009-499f-b0d8-4194cbf76f1a {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:56:59 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2950e1a9-663b-443b-a9c8-da5cd39ae8b3]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-250faf52-ad40-46b1-b93d-900a89ca87f1 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.fb396720-2009-499f-b0d8-4194cbf76f1a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:59 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_bekkwoz8" returned: 0 in 0.425s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_bekkwoz8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:59 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.fb396720-2009-499f-b0d8-4194cbf76f1a Sep 16 17:56:59 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:59 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_bekkwoz8 Sep 16 17:56:59 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:59 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5d3e47ae-ca68-48f4-9bb3-8cba0c62af3a tempest-VolumeDependencyTests-1408803358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754" returned: 0 in 0.841s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5d3e47ae-ca68-48f4-9bb3-8cba0c62af3a tempest-VolumeDependencyTests-1408803358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.26caeb34-f1a6-497f-b1c0-0e7a5ec0e650 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:59 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.26caeb34-f1a6-497f-b1c0-0e7a5ec0e650 Sep 16 17:56:59 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:59 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-250faf52-ad40-46b1-b93d-900a89ca87f1 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.fb396720-2009-499f-b0d8-4194cbf76f1a" returned: 0 in 0.609s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:59 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-250faf52-ad40-46b1-b93d-900a89ca87f1 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-362ec939-081a-4d61-8492-01bd00f719e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:56:59 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Sep 16 17:56:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_bekkwoz8" returned: 1 in 0.527s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:56:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_bekkwoz8' failed. Not Retrying. {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:56:59 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc394359-2611-41ed-8b48-dfc3ab2c05de]: (4, 'raw') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:59 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadcc9c5-2f52-40ef-8315-9326d103989e]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:56:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-250faf52-ad40-46b1-b93d-900a89ca87f1 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:56:59 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1 Sep 16 17:56:59 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:56:59 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD Sep 16 17:56:59 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:00 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5d3e47ae-ca68-48f4-9bb3-8cba0c62af3a tempest-VolumeDependencyTests-1408803358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.26caeb34-f1a6-497f-b1c0-0e7a5ec0e650" returned: 0 in 0.452s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5d3e47ae-ca68-48f4-9bb3-8cba0c62af3a tempest-VolumeDependencyTests-1408803358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.26caeb34-f1a6-497f-b1c0-0e7a5ec0e650 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:00 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.26caeb34-f1a6-497f-b1c0-0e7a5ec0e650 Sep 16 17:57:00 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:00 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:00 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-250faf52-ad40-46b1-b93d-900a89ca87f1 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1" returned: 0 in 0.472s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-250faf52-ad40-46b1-b93d-900a89ca87f1 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.fb396720-2009-499f-b0d8-4194cbf76f1a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:00 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.fb396720-2009-499f-b0d8-4194cbf76f1a Sep 16 17:57:00 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:00 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD Sep 16 17:57:00 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:00 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5d3e47ae-ca68-48f4-9bb3-8cba0c62af3a tempest-VolumeDependencyTests-1408803358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754.26caeb34-f1a6-497f-b1c0-0e7a5ec0e650" returned: 0 in 0.317s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5d3e47ae-ca68-48f4-9bb3-8cba0c62af3a tempest-VolumeDependencyTests-1408803358 None] Lock "cinder-quobyte-26caeb34-f1a6-497f-b1c0-0e7a5ec0e650" released by "_delete_snapshot" :: held 2.195s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5d3e47ae-ca68-48f4-9bb3-8cba0c62af3a tempest-VolumeDependencyTests-1408803358 None] Lock "cinder-quobyte-1d1926ff-1b90-4dbd-b01f-630dc628d754" released by "delete_snapshot" :: held 2.229s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:00 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-5d3e47ae-ca68-48f4-9bb3-8cba0c62af3a tempest-VolumeDependencyTests-1408803358 None] Created reservations ['ff9a50e9-f7ca-449e-acf3-dca2247dbb5f', 'bc906127-1881-496e-9430-911f6b1ac937', '12604def-10a3-42ab-b15d-420e688f7eb4', 'd8e9d4bc-3e6f-40ce-9195-3e48b3a1250f'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:00 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD" returned: 1 in 0.438s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 17:57:00 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] 2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085 was raw, converting to qcow2 {{(pid=85899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 16 17:57:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d010cdc8-a87a-4198-b018-08394417faec {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:00 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d010cdc8-a87a-4198-b018-08394417faec Sep 16 17:57:00 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:00 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5d3e47ae-ca68-48f4-9bb3-8cba0c62af3a tempest-VolumeDependencyTests-1408803358 None] Delete snapshot completed successfully. Sep 16 17:57:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5d3e47ae-ca68-48f4-9bb3-8cba0c62af3a tempest-VolumeDependencyTests-1408803358 None] Lock "cinder-26caeb34-f1a6-497f-b1c0-0e7a5ec0e650-delete_snapshot" released by "delete_snapshot" :: held 2.538s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:00 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-250faf52-ad40-46b1-b93d-900a89ca87f1 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.fb396720-2009-499f-b0d8-4194cbf76f1a" returned: 0 in 0.498s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-250faf52-ad40-46b1-b93d-900a89ca87f1 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.fb396720-2009-499f-b0d8-4194cbf76f1a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:00 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.fb396720-2009-499f-b0d8-4194cbf76f1a Sep 16 17:57:00 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:00 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-250faf52-ad40-46b1-b93d-900a89ca87f1 tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1.fb396720-2009-499f-b0d8-4194cbf76f1a" returned: 0 in 0.269s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-250faf52-ad40-46b1-b93d-900a89ca87f1 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-quobyte-fb396720-2009-499f-b0d8-4194cbf76f1a" released by "_delete_snapshot" :: held 1.995s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-250faf52-ad40-46b1-b93d-900a89ca87f1 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-quobyte-362ec939-081a-4d61-8492-01bd00f719e1" released by "delete_snapshot" :: held 2.018s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:01 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-250faf52-ad40-46b1-b93d-900a89ca87f1 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Created reservations ['34a207d0-04de-48e3-b2b0-c62950d1e498', 'f3d3732c-b01c-476c-bdf0-fb4ba847f18d', '3a61f1b1-603d-4e19-893c-33610ee1fe63', '49512314-97bd-459f-bf4f-050c63295cca'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:01 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d010cdc8-a87a-4198-b018-08394417faec" returned: 0 in 0.560s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:01 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085_2h17n7rbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d010cdc8-a87a-4198-b018-08394417faec {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:57:01 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Converted 0.00 MB image at 0.00 MB/s Sep 16 17:57:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d010cdc8-a87a-4198-b018-08394417faec 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:01 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d010cdc8-a87a-4198-b018-08394417faec 1G Sep 16 17:57:01 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:01 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-250faf52-ad40-46b1-b93d-900a89ca87f1 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Delete snapshot completed successfully. Sep 16 17:57:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-250faf52-ad40-46b1-b93d-900a89ca87f1 tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-fb396720-2009-499f-b0d8-4194cbf76f1a-delete_snapshot" released by "delete_snapshot" :: held 2.220s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-102477ad-da01-4259-aa01-24e452c18157 tempest-VolumeDependencyTests-1408803358 None] Acquiring lock "cinder-1d1926ff-1b90-4dbd-b01f-630dc628d754-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-102477ad-da01-4259-aa01-24e452c18157 tempest-VolumeDependencyTests-1408803358 None] Lock "cinder-1d1926ff-1b90-4dbd-b01f-630dc628d754-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-102477ad-da01-4259-aa01-24e452c18157 tempest-VolumeDependencyTests-1408803358 None] Acquiring lock "cinder-quobyte-1d1926ff-1b90-4dbd-b01f-630dc628d754" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-102477ad-da01-4259-aa01-24e452c18157 tempest-VolumeDependencyTests-1408803358 None] Lock "cinder-quobyte-1d1926ff-1b90-4dbd-b01f-630dc628d754" acquired by "delete_volume" :: waited 0.015s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:01 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[246ef2fb-bada-4313-aebd-92d1b1200ff2]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-102477ad-da01-4259-aa01-24e452c18157 tempest-VolumeDependencyTests-1408803358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:01 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d010cdc8-a87a-4198-b018-08394417faec 1G" returned: 0 in 0.446s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:01 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Downloaded image 2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085 ((None, [{'url': 'file:///opt/stack/data/glance/images/2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085', 'metadata': {}}])) to volume d010cdc8-a87a-4198-b018-08394417faec successfully. {{(pid=85899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 17:57:01 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Temporary image 2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085 for user 88612389361f46b1a04d33c3a9b2e63d is deleted. {{(pid=85899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 16 17:57:01 devstack cinder-volume[85899]: DEBUG cinder.volume.volume_utils [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Marking volume d010cdc8-a87a-4198-b018-08394417faec as bootable. {{(pid=85899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 17:57:01 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Copying metadata from image 2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085 to d010cdc8-a87a-4198-b018-08394417faec. {{(pid=85899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 17:57:01 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Creating volume glance metadata for volume d010cdc8-a87a-4198-b018-08394417faec backed by image 2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085 with: {'image_id': '2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '77b274c01fa4e30e919bdb48a7fda29b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 17:57:01 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754 Sep 16 17:57:01 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531615a6-b18f-436c-b605-9f9aaf9b9349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d010cdc8-a87a-4198-b018-08394417faec', 'volume_size': 1, 'image_id': '2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '77b274c01fa4e30e919bdb48a7fda29b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '13e6797a711241b89135542376189a63', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '92b8e26caf33713774cc18cd02ab935792837db73325f3246fbf0de4f58f5a519a118a656df3d67b5aad9c7e4dad82b77e444c0adc63e5ea39c2a015562f734f', 'id': '2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085', 'created_at': datetime.datetime(2026, 9, 16, 15, 56, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 15, 56, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2e59aa90-e5d0-47f9-9fa0-8ef14f1d1085/file', 'properties': {}}, 'image_service': }' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0758e61-21f7-42d2-abf5-28b6a0f2b6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:01 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Volume volume-d010cdc8-a87a-4198-b018-08394417faec (d010cdc8-a87a-4198-b018-08394417faec): created successfully Sep 16 17:57:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0758e61-21f7-42d2-abf5-28b6a0f2b6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Flow 'volume_create_manager' (30be67c4-3fbf-480e-8831-b3a540977e0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:01 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-fc24c431-5494-4424-997c-378b56bb766b tempest-VolumeImageDependencyTests-428102029 None] Created volume successfully. Sep 16 17:57:01 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-102477ad-da01-4259-aa01-24e452c18157 tempest-VolumeDependencyTests-1408803358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754" returned: 0 in 0.433s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-102477ad-da01-4259-aa01-24e452c18157 tempest-VolumeDependencyTests-1408803358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:01 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754 Sep 16 17:57:01 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-993bcb8a-cd54-4a50-9433-a830dfbb704c tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "cinder-362ec939-081a-4d61-8492-01bd00f719e1-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-993bcb8a-cd54-4a50-9433-a830dfbb704c tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-362ec939-081a-4d61-8492-01bd00f719e1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:02 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-102477ad-da01-4259-aa01-24e452c18157 tempest-VolumeDependencyTests-1408803358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-1d1926ff-1b90-4dbd-b01f-630dc628d754" returned: 0 in 0.317s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-993bcb8a-cd54-4a50-9433-a830dfbb704c tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "cinder-quobyte-362ec939-081a-4d61-8492-01bd00f719e1" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-102477ad-da01-4259-aa01-24e452c18157 tempest-VolumeDependencyTests-1408803358 None] Lock "cinder-quobyte-1d1926ff-1b90-4dbd-b01f-630dc628d754" released by "delete_volume" :: held 0.863s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:02 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:57:02 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-993bcb8a-cd54-4a50-9433-a830dfbb704c tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-quobyte-362ec939-081a-4d61-8492-01bd00f719e1" acquired by "delete_volume" :: waited 0.030s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7270da1f-7b5d-4631-bffe-59e7844e35fc]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-993bcb8a-cd54-4a50-9433-a830dfbb704c tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-102477ad-da01-4259-aa01-24e452c18157 tempest-VolumeDependencyTests-1408803358 None] Created reservations ['f3add305-9741-44ac-b46f-f685c3f08cb8', 'ef7f67dd-76c8-4f8e-8137-cc0696090c15', 'f6d73488-4ece-43fb-826d-6eb4ff7fdf91', 'e809d49c-bba8-496c-87fc-90f2f38ce405'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-102477ad-da01-4259-aa01-24e452c18157 tempest-VolumeDependencyTests-1408803358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-102477ad-da01-4259-aa01-24e452c18157 tempest-VolumeDependencyTests-1408803358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-102477ad-da01-4259-aa01-24e452c18157 tempest-VolumeDependencyTests-1408803358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-102477ad-da01-4259-aa01-24e452c18157 tempest-VolumeDependencyTests-1408803358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-102477ad-da01-4259-aa01-24e452c18157 tempest-VolumeDependencyTests-1408803358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-102477ad-da01-4259-aa01-24e452c18157 tempest-VolumeDependencyTests-1408803358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bb518fed-38fa-4fa2-ba80-9e6cc0c8e243 tempest-VolumeDependencyTests-1408803358 None] Acquiring lock "cinder-07903e78-3310-4d00-88fa-ff6d5e04dc75-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:02 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1 Sep 16 17:57:02 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:02 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:57:02 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bb518fed-38fa-4fa2-ba80-9e6cc0c8e243 tempest-VolumeDependencyTests-1408803358 None] Lock "cinder-07903e78-3310-4d00-88fa-ff6d5e04dc75-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:02 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.444s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bb518fed-38fa-4fa2-ba80-9e6cc0c8e243 tempest-VolumeDependencyTests-1408803358 None] Acquiring lock "cinder-quobyte-07903e78-3310-4d00-88fa-ff6d5e04dc75" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager._thread_info {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread count: 29 {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread info: [<_MainThread(MainThread, started 123748124422272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bb518fed-38fa-4fa2-ba80-9e6cc0c8e243 tempest-VolumeDependencyTests-1408803358 None] Lock "cinder-quobyte-07903e78-3310-4d00-88fa-ff6d5e04dc75" acquired by "delete_volume" :: waited 0.056s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c2ceb4-4b1c-4f08-afa5-4719f441f2a0]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bb518fed-38fa-4fa2-ba80-9e6cc0c8e243 tempest-VolumeDependencyTests-1408803358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-07903e78-3310-4d00-88fa-ff6d5e04dc75 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e9cae12b-9cf2-469b-8ae4-4db26dcd44c1 tempest-VolumeImageDependencyTests-428102029 None] Acquiring lock "cinder-d010cdc8-a87a-4198-b018-08394417faec-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e9cae12b-9cf2-469b-8ae4-4db26dcd44c1 tempest-VolumeImageDependencyTests-428102029 None] Lock "cinder-d010cdc8-a87a-4198-b018-08394417faec-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e9cae12b-9cf2-469b-8ae4-4db26dcd44c1 tempest-VolumeImageDependencyTests-428102029 None] Acquiring lock "cinder-quobyte-d010cdc8-a87a-4198-b018-08394417faec" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:03 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-07903e78-3310-4d00-88fa-ff6d5e04dc75 Sep 16 17:57:03 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:03 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-102477ad-da01-4259-aa01-24e452c18157 tempest-VolumeDependencyTests-1408803358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.485s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-102477ad-da01-4259-aa01-24e452c18157 tempest-VolumeDependencyTests-1408803358 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:57:03 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-102477ad-da01-4259-aa01-24e452c18157 tempest-VolumeDependencyTests-1408803358 None] Deleted volume successfully. Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e9cae12b-9cf2-469b-8ae4-4db26dcd44c1 tempest-VolumeImageDependencyTests-428102029 None] Lock "cinder-quobyte-d010cdc8-a87a-4198-b018-08394417faec" acquired by "delete_volume" :: waited 0.035s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:03 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-993bcb8a-cd54-4a50-9433-a830dfbb704c tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1" returned: 0 in 0.708s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-993bcb8a-cd54-4a50-9433-a830dfbb704c tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4971c3b6-8e8f-4f33-a945-3981d8512716]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e9cae12b-9cf2-469b-8ae4-4db26dcd44c1 tempest-VolumeImageDependencyTests-428102029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d010cdc8-a87a-4198-b018-08394417faec {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:03 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1 Sep 16 17:57:03 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-102477ad-da01-4259-aa01-24e452c18157 tempest-VolumeDependencyTests-1408803358 None] Lock "cinder-1d1926ff-1b90-4dbd-b01f-630dc628d754-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:03 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d010cdc8-a87a-4198-b018-08394417faec Sep 16 17:57:03 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:03 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-993bcb8a-cd54-4a50-9433-a830dfbb704c tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-362ec939-081a-4d61-8492-01bd00f719e1" returned: 0 in 0.306s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-993bcb8a-cd54-4a50-9433-a830dfbb704c tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-quobyte-362ec939-081a-4d61-8492-01bd00f719e1" released by "delete_volume" :: held 1.101s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-993bcb8a-cd54-4a50-9433-a830dfbb704c tempest-CreateVolumesFromSnapshotTest-1511236129 None] Created reservations ['27131385-c4c6-4ac2-9b24-19eb7852daf8', '20029eeb-2073-4016-bafb-8654c13b08c0', 'fe485c83-0b91-4ca1-9a42-cdedd8ec6900', '585c7151-135b-4463-acf3-e7516c0cf11e'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:03 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bb518fed-38fa-4fa2-ba80-9e6cc0c8e243 tempest-VolumeDependencyTests-1408803358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-07903e78-3310-4d00-88fa-ff6d5e04dc75" returned: 0 in 0.664s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bb518fed-38fa-4fa2-ba80-9e6cc0c8e243 tempest-VolumeDependencyTests-1408803358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-07903e78-3310-4d00-88fa-ff6d5e04dc75 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:03 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-07903e78-3310-4d00-88fa-ff6d5e04dc75 Sep 16 17:57:03 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:03 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e9cae12b-9cf2-469b-8ae4-4db26dcd44c1 tempest-VolumeImageDependencyTests-428102029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d010cdc8-a87a-4198-b018-08394417faec" returned: 0 in 0.439s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e9cae12b-9cf2-469b-8ae4-4db26dcd44c1 tempest-VolumeImageDependencyTests-428102029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d010cdc8-a87a-4198-b018-08394417faec {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-993bcb8a-cd54-4a50-9433-a830dfbb704c tempest-CreateVolumesFromSnapshotTest-1511236129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-993bcb8a-cd54-4a50-9433-a830dfbb704c tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-993bcb8a-cd54-4a50-9433-a830dfbb704c tempest-CreateVolumesFromSnapshotTest-1511236129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:03 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d010cdc8-a87a-4198-b018-08394417faec Sep 16 17:57:03 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-993bcb8a-cd54-4a50-9433-a830dfbb704c tempest-CreateVolumesFromSnapshotTest-1511236129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-993bcb8a-cd54-4a50-9433-a830dfbb704c tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-993bcb8a-cd54-4a50-9433-a830dfbb704c tempest-CreateVolumesFromSnapshotTest-1511236129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:03 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:57:03 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:03 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bb518fed-38fa-4fa2-ba80-9e6cc0c8e243 tempest-VolumeDependencyTests-1408803358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-07903e78-3310-4d00-88fa-ff6d5e04dc75" returned: 0 in 0.338s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bb518fed-38fa-4fa2-ba80-9e6cc0c8e243 tempest-VolumeDependencyTests-1408803358 None] Lock "cinder-quobyte-07903e78-3310-4d00-88fa-ff6d5e04dc75" released by "delete_volume" :: held 1.075s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:03 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e9cae12b-9cf2-469b-8ae4-4db26dcd44c1 tempest-VolumeImageDependencyTests-428102029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-d010cdc8-a87a-4198-b018-08394417faec" returned: 0 in 0.346s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e9cae12b-9cf2-469b-8ae4-4db26dcd44c1 tempest-VolumeImageDependencyTests-428102029 None] Lock "cinder-quobyte-d010cdc8-a87a-4198-b018-08394417faec" released by "delete_volume" :: held 0.857s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:03 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-bb518fed-38fa-4fa2-ba80-9e6cc0c8e243 tempest-VolumeDependencyTests-1408803358 None] Created reservations ['eea8ef8e-9e77-47c6-b93c-abf7ded87e76', '276b4878-c8bf-4d84-8a4c-0496f4e67a05', '254174d2-5284-4dbc-87d2-088c4ad29e86', '346c1e68-d4f8-4f03-8947-7ed335a8160c'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-993bcb8a-cd54-4a50-9433-a830dfbb704c tempest-CreateVolumesFromSnapshotTest-1511236129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.369s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-993bcb8a-cd54-4a50-9433-a830dfbb704c tempest-CreateVolumesFromSnapshotTest-1511236129 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:57:03 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-993bcb8a-cd54-4a50-9433-a830dfbb704c tempest-CreateVolumesFromSnapshotTest-1511236129 None] Deleted volume successfully. Sep 16 17:57:03 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-993bcb8a-cd54-4a50-9433-a830dfbb704c tempest-CreateVolumesFromSnapshotTest-1511236129 None] Lock "cinder-362ec939-081a-4d61-8492-01bd00f719e1-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bb518fed-38fa-4fa2-ba80-9e6cc0c8e243 tempest-VolumeDependencyTests-1408803358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bb518fed-38fa-4fa2-ba80-9e6cc0c8e243 tempest-VolumeDependencyTests-1408803358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:04 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-bb518fed-38fa-4fa2-ba80-9e6cc0c8e243 tempest-VolumeDependencyTests-1408803358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:04 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-bb518fed-38fa-4fa2-ba80-9e6cc0c8e243 tempest-VolumeDependencyTests-1408803358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bb518fed-38fa-4fa2-ba80-9e6cc0c8e243 tempest-VolumeDependencyTests-1408803358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bb518fed-38fa-4fa2-ba80-9e6cc0c8e243 tempest-VolumeDependencyTests-1408803358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:04 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-e9cae12b-9cf2-469b-8ae4-4db26dcd44c1 tempest-VolumeImageDependencyTests-428102029 None] Created reservations ['b06c8779-5d44-470c-a2c7-9e1b28b64654', '6dd33c29-54f2-449b-a7af-8b3e5d544bc8', 'c3d32f47-2543-4e35-b2d8-f4275d2e32fb', '6456f82d-fe4b-4d46-8c15-f9fabf1fcdce'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:04 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:57:04 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e9cae12b-9cf2-469b-8ae4-4db26dcd44c1 tempest-VolumeImageDependencyTests-428102029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e9cae12b-9cf2-469b-8ae4-4db26dcd44c1 tempest-VolumeImageDependencyTests-428102029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:04 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e9cae12b-9cf2-469b-8ae4-4db26dcd44c1 tempest-VolumeImageDependencyTests-428102029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:04 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e9cae12b-9cf2-469b-8ae4-4db26dcd44c1 tempest-VolumeImageDependencyTests-428102029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e9cae12b-9cf2-469b-8ae4-4db26dcd44c1 tempest-VolumeImageDependencyTests-428102029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e9cae12b-9cf2-469b-8ae4-4db26dcd44c1 tempest-VolumeImageDependencyTests-428102029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:04 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:57:04 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:04 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bb518fed-38fa-4fa2-ba80-9e6cc0c8e243 tempest-VolumeDependencyTests-1408803358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.288s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:04 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-bb518fed-38fa-4fa2-ba80-9e6cc0c8e243 tempest-VolumeDependencyTests-1408803358 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:57:04 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-bb518fed-38fa-4fa2-ba80-9e6cc0c8e243 tempest-VolumeDependencyTests-1408803358 None] Deleted volume successfully. Sep 16 17:57:04 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bb518fed-38fa-4fa2-ba80-9e6cc0c8e243 tempest-VolumeDependencyTests-1408803358 None] Lock "cinder-07903e78-3310-4d00-88fa-ff6d5e04dc75-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:04 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e9cae12b-9cf2-469b-8ae4-4db26dcd44c1 tempest-VolumeImageDependencyTests-428102029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.315s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:04 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-e9cae12b-9cf2-469b-8ae4-4db26dcd44c1 tempest-VolumeImageDependencyTests-428102029 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:57:04 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-e9cae12b-9cf2-469b-8ae4-4db26dcd44c1 tempest-VolumeImageDependencyTests-428102029 None] Deleted volume successfully. Sep 16 17:57:04 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-e9cae12b-9cf2-469b-8ae4-4db26dcd44c1 tempest-VolumeImageDependencyTests-428102029 None] Lock "cinder-d010cdc8-a87a-4198-b018-08394417faec-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-70ae8371-53a1-4777-bc30-5d792dc55428 tempest-ProjectAdminTests-672706614 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8084831237793, 'free_capacity_gb': 1775.8084831237793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85899) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4826}} Sep 16 17:57:11 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:57:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Flow 'volume_create_manager' (a5b32e1e-9187-4019-b6ce-b666a12117aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df13235-7546-4dd2-a329-369f513fc90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df13235-7546-4dd2-a329-369f513fc90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1035188249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e2b210-6d37-432e-95b1-1bef4a7a1b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86c45c52eba4c698ff7edf1ea9c075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:57:12Z,use_quota=True,user_id='ff634f34ed8b49ceaa2f8e9b6bee7419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed3e8a0-82dc-4382-a2be-a66706219381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed3e8a0-82dc-4382-a2be-a66706219381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (610333a1-7898-44f2-b24d-47bcec939911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (610333a1-7898-44f2-b24d-47bcec939911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4e2b210-6d37-432e-95b1-1bef4a7a1b97', 'volume_name': 'volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4ecfcf-05b5-4352-88d5-260d212e4577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4ecfcf-05b5-4352-88d5-260d212e4577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:11 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce8b0b8-1fb3-4d5b-a6cb-8580c798b749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:11 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Volume b4e2b210-6d37-432e-95b1-1bef4a7a1b97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97', 'volume_size': 1} Sep 16 17:57:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1035188249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e2b210-6d37-432e-95b1-1bef4a7a1b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86c45c52eba4c698ff7edf1ea9c075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:57:12Z,use_quota=True,user_id='ff634f34ed8b49ceaa2f8e9b6bee7419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:57:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Creating volume b4e2b210-6d37-432e-95b1-1bef4a7a1b97 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:57:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:57:11 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:57:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:11 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97 1073741824 Sep 16 17:57:11 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:12 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97 1073741824" returned: 0 in 0.853s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:12 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=202,cinder:UPDATE=282,cinder:INSERT=76,cinder:DELETE=32 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:57:12 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:UPDATE=275,cinder:SELECT=204,cinder:INSERT=73,cinder:DELETE=17 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:57:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:12 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97 Sep 16 17:57:12 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:13 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97" returned: 0 in 0.270s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:13 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:57:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:13 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce8b0b8-1fb3-4d5b-a6cb-8580c798b749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:13 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d1da4d-b6fb-4c0d-a02e-f4d27b5e6575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:13 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Volume volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97 (b4e2b210-6d37-432e-95b1-1bef4a7a1b97): created successfully Sep 16 17:57:13 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d1da4d-b6fb-4c0d-a02e-f4d27b5e6575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:13 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Flow 'volume_create_manager' (a5b32e1e-9187-4019-b6ce-b666a12117aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:13 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-a06a6e80-a91b-4fbe-8bb4-74a5026ac4e2 tempest-ProjectMemberTests-1735269541 None] Created volume successfully. Sep 16 17:57:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-727ef958-a394-48f6-b406-894f4716c448 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-727ef958-a394-48f6-b406-894f4716c448 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-727ef958-a394-48f6-b406-894f4716c448 tempest-ProjectMemberTests-1735269541 None] Creating offline snapshot 390a017f-853f-4f2b-99b6-a492290df270 of volume b4e2b210-6d37-432e-95b1-1bef4a7a1b97 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:57:14 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b007d2e-6c06-4be9-97cf-79206c85f451]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-727ef958-a394-48f6-b406-894f4716c448 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:14 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97 Sep 16 17:57:14 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:14 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-727ef958-a394-48f6-b406-894f4716c448 tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97" returned: 0 in 0.412s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-727ef958-a394-48f6-b406-894f4716c448 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.390a017f-853f-4f2b-99b6-a492290df270 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:14 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.390a017f-853f-4f2b-99b6-a492290df270 1G Sep 16 17:57:14 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:15 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-727ef958-a394-48f6-b406-894f4716c448 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.390a017f-853f-4f2b-99b6-a492290df270 1G" returned: 0 in 0.558s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-727ef958-a394-48f6-b406-894f4716c448 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.390a017f-853f-4f2b-99b6-a492290df270 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:15 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.390a017f-853f-4f2b-99b6-a492290df270 Sep 16 17:57:15 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:15 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-727ef958-a394-48f6-b406-894f4716c448 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.390a017f-853f-4f2b-99b6-a492290df270" returned: 0 in 0.403s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:15 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-727ef958-a394-48f6-b406-894f4716c448 tempest-ProjectMemberTests-1735269541 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.390a017f-853f-4f2b-99b6-a492290df270 is being set with open permissions: ugo+rw Sep 16 17:57:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-727ef958-a394-48f6-b406-894f4716c448 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.390a017f-853f-4f2b-99b6-a492290df270 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:15 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.390a017f-853f-4f2b-99b6-a492290df270 Sep 16 17:57:15 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:16 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-727ef958-a394-48f6-b406-894f4716c448 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.390a017f-853f-4f2b-99b6-a492290df270" returned: 0 in 0.399s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-727ef958-a394-48f6-b406-894f4716c448 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:16 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.info Sep 16 17:57:16 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:16 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-727ef958-a394-48f6-b406-894f4716c448 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.info" returned: 0 in 0.486s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:16 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-727ef958-a394-48f6-b406-894f4716c448 tempest-ProjectMemberTests-1735269541 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.info is being set with open permissions: ugo+rw Sep 16 17:57:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-727ef958-a394-48f6-b406-894f4716c448 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:16 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.info Sep 16 17:57:16 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:17 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-727ef958-a394-48f6-b406-894f4716c448 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.info" returned: 0 in 0.340s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-727ef958-a394-48f6-b406-894f4716c448 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.732s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:17 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-727ef958-a394-48f6-b406-894f4716c448 tempest-ProjectMemberTests-1735269541 None] Create snapshot completed successfully Sep 16 17:57:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f05c8b09-b354-4629-94f6-7eb29db1ec6b tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-390a017f-853f-4f2b-99b6-a492290df270-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f05c8b09-b354-4629-94f6-7eb29db1ec6b tempest-ProjectMemberTests-1735269541 None] Lock "cinder-390a017f-853f-4f2b-99b6-a492290df270-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f05c8b09-b354-4629-94f6-7eb29db1ec6b tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-b4e2b210-6d37-432e-95b1-1bef4a7a1b97" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f05c8b09-b354-4629-94f6-7eb29db1ec6b tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-b4e2b210-6d37-432e-95b1-1bef4a7a1b97" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f05c8b09-b354-4629-94f6-7eb29db1ec6b tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-390a017f-853f-4f2b-99b6-a492290df270" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f05c8b09-b354-4629-94f6-7eb29db1ec6b tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-390a017f-853f-4f2b-99b6-a492290df270" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-f05c8b09-b354-4629-94f6-7eb29db1ec6b tempest-ProjectMemberTests-1735269541 None] Deleting offline snapshot 390a017f-853f-4f2b-99b6-a492290df270 of volume b4e2b210-6d37-432e-95b1-1bef4a7a1b97 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:57:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-f05c8b09-b354-4629-94f6-7eb29db1ec6b tempest-ProjectMemberTests-1735269541 None] snapshot_file for this snap is: volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.390a017f-853f-4f2b-99b6-a492290df270 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:57:17 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[30563f8a-ce54-45c0-ae10-6b76ba89eae2]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f05c8b09-b354-4629-94f6-7eb29db1ec6b tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.390a017f-853f-4f2b-99b6-a492290df270 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:17 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.390a017f-853f-4f2b-99b6-a492290df270 Sep 16 17:57:17 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:18 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f05c8b09-b354-4629-94f6-7eb29db1ec6b tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.390a017f-853f-4f2b-99b6-a492290df270" returned: 0 in 0.491s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-f05c8b09-b354-4629-94f6-7eb29db1ec6b tempest-ProjectMemberTests-1735269541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:57:18 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed244d8-518d-4aa9-970a-4aa138f2f56e]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f05c8b09-b354-4629-94f6-7eb29db1ec6b tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:18 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97 Sep 16 17:57:18 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:18 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f05c8b09-b354-4629-94f6-7eb29db1ec6b tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97" returned: 0 in 0.419s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f05c8b09-b354-4629-94f6-7eb29db1ec6b tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.390a017f-853f-4f2b-99b6-a492290df270 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:18 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.390a017f-853f-4f2b-99b6-a492290df270 Sep 16 17:57:18 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:19 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f05c8b09-b354-4629-94f6-7eb29db1ec6b tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.390a017f-853f-4f2b-99b6-a492290df270" returned: 0 in 0.481s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f05c8b09-b354-4629-94f6-7eb29db1ec6b tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.390a017f-853f-4f2b-99b6-a492290df270 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:57:19 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.390a017f-853f-4f2b-99b6-a492290df270 Sep 16 17:57:19 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Flow 'volume_create_manager' (fd52ed24-05a6-474b-995d-fde4b83dc7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02708d8-106c-4cb4-a8ca-0bf9e8e03dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02708d8-106c-4cb4-a8ca-0bf9e8e03dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1108325394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05671c17-2d94-4490-86df-8fac0228e9c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f877fd6e992c4fa4816ae5c13df3dafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:57:19Z,use_quota=True,user_id='f04587632b0047709ddedda79942f948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605c6789-2b98-44d1-811c-6af6af688fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605c6789-2b98-44d1-811c-6af6af688fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4bb917-b26e-4ec3-b45b-2b81dce7b78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4bb917-b26e-4ec3-b45b-2b81dce7b78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05671c17-2d94-4490-86df-8fac0228e9c8', 'volume_name': 'volume-05671c17-2d94-4490-86df-8fac0228e9c8', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a036303e-114f-42ab-8a11-c123f32881ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a036303e-114f-42ab-8a11-c123f32881ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fdcd4ba-15f7-4819-8197-9aa5296d8fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:19 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Volume 05671c17-2d94-4490-86df-8fac0228e9c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05671c17-2d94-4490-86df-8fac0228e9c8', 'volume_size': 1} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1108325394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05671c17-2d94-4490-86df-8fac0228e9c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f877fd6e992c4fa4816ae5c13df3dafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:57:19Z,use_quota=True,user_id='f04587632b0047709ddedda79942f948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Creating volume 05671c17-2d94-4490-86df-8fac0228e9c8 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:57:19 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:19 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8 1073741824 Sep 16 17:57:19 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:19 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f05c8b09-b354-4629-94f6-7eb29db1ec6b tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97.390a017f-853f-4f2b-99b6-a492290df270" returned: 0 in 0.355s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f05c8b09-b354-4629-94f6-7eb29db1ec6b tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-390a017f-853f-4f2b-99b6-a492290df270" released by "_delete_snapshot" :: held 1.940s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f05c8b09-b354-4629-94f6-7eb29db1ec6b tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-b4e2b210-6d37-432e-95b1-1bef4a7a1b97" released by "delete_snapshot" :: held 1.996s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-f05c8b09-b354-4629-94f6-7eb29db1ec6b tempest-ProjectMemberTests-1735269541 None] Created reservations ['03058f91-b37c-4cf4-9260-8fcff5c8925d', 'cf384507-4ba4-4ade-9181-ed82598b7766', 'f7c290da-57a4-4fc0-8089-bf9cd15238a2', '8a8fb0b6-9567-4e03-a0c8-dc1ef52f0c3a'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Flow 'volume_create_manager' (5772f5aa-45ff-4308-a7c2-ed4eb30cce70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d76c9046-42cc-4ae2-9f86-f15ec5e0ec09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:19 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-f05c8b09-b354-4629-94f6-7eb29db1ec6b tempest-ProjectMemberTests-1735269541 None] Delete snapshot completed successfully. Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d76c9046-42cc-4ae2-9f86-f15ec5e0ec09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1219450114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1b2731e-5752-4d82-8ffc-dab9b5277df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acc44de033a44ae49b32e5c1e0bc6cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:57:20Z,use_quota=True,user_id='1991573cd4144a87b1efd0d93741f87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce4553b6-604c-4858-930e-e209234dbc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce4553b6-604c-4858-930e-e209234dbc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:19 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0df7917-6621-4247-bce8-4385713b9042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0df7917-6621-4247-bce8-4385713b9042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1b2731e-5752-4d82-8ffc-dab9b5277df5', 'volume_name': 'volume-e1b2731e-5752-4d82-8ffc-dab9b5277df5', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8d260d-8471-4c1f-8427-4cd478a0c9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8d260d-8471-4c1f-8427-4cd478a0c9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a8c4c3-e3ee-47d0-84aa-69273942aee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:19 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Volume e1b2731e-5752-4d82-8ffc-dab9b5277df5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1b2731e-5752-4d82-8ffc-dab9b5277df5', 'volume_size': 1} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-223e7fbb-4881-4d11-b8c6-ad76456a947e tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-b4e2b210-6d37-432e-95b1-1bef4a7a1b97-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8 1073741824" returned: 0 in 0.652s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-f05c8b09-b354-4629-94f6-7eb29db1ec6b tempest-ProjectMemberTests-1735269541 None] Lock "cinder-390a017f-853f-4f2b-99b6-a492290df270-delete_snapshot" released by "delete_snapshot" :: held 2.355s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-223e7fbb-4881-4d11-b8c6-ad76456a947e tempest-ProjectMemberTests-1735269541 None] Lock "cinder-b4e2b210-6d37-432e-95b1-1bef4a7a1b97-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:20 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8 Sep 16 17:57:20 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-223e7fbb-4881-4d11-b8c6-ad76456a947e tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-b4e2b210-6d37-432e-95b1-1bef4a7a1b97" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-223e7fbb-4881-4d11-b8c6-ad76456a947e tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-b4e2b210-6d37-432e-95b1-1bef4a7a1b97" acquired by "delete_volume" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[af390957-4924-45ba-af29-823a9496ae1a]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-223e7fbb-4881-4d11-b8c6-ad76456a947e tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:20 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97 Sep 16 17:57:20 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:20 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8" returned: 0 in 0.270s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.326s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1219450114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1b2731e-5752-4d82-8ffc-dab9b5277df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acc44de033a44ae49b32e5c1e0bc6cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:57:20Z,use_quota=True,user_id='1991573cd4144a87b1efd0d93741f87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Creating volume e1b2731e-5752-4d82-8ffc-dab9b5277df5 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:57:20 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1b2731e-5752-4d82-8ffc-dab9b5277df5 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fdcd4ba-15f7-4819-8197-9aa5296d8fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05671c17-2d94-4490-86df-8fac0228e9c8', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:20 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1b2731e-5752-4d82-8ffc-dab9b5277df5 1073741824 Sep 16 17:57:20 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13b503d-077e-462b-9110-8f2125196d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:20 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Volume volume-05671c17-2d94-4490-86df-8fac0228e9c8 (05671c17-2d94-4490-86df-8fac0228e9c8): created successfully Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13b503d-077e-462b-9110-8f2125196d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Flow 'volume_create_manager' (fd52ed24-05a6-474b-995d-fde4b83dc7f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:20 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-e8937e1b-6bc9-4473-ac6e-6291124c0ada tempest-SnapshotDependencyTests-590997139 None] Created volume successfully. Sep 16 17:57:20 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-223e7fbb-4881-4d11-b8c6-ad76456a947e tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97" returned: 0 in 0.427s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-223e7fbb-4881-4d11-b8c6-ad76456a947e tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:20 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97 Sep 16 17:57:20 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:20 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1b2731e-5752-4d82-8ffc-dab9b5277df5 1073741824" returned: 0 in 0.546s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:20 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-223e7fbb-4881-4d11-b8c6-ad76456a947e tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-b4e2b210-6d37-432e-95b1-1bef4a7a1b97" returned: 0 in 0.310s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1b2731e-5752-4d82-8ffc-dab9b5277df5 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-223e7fbb-4881-4d11-b8c6-ad76456a947e tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-b4e2b210-6d37-432e-95b1-1bef4a7a1b97" released by "delete_volume" :: held 0.832s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:20 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1b2731e-5752-4d82-8ffc-dab9b5277df5 Sep 16 17:57:20 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:20 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-223e7fbb-4881-4d11-b8c6-ad76456a947e tempest-ProjectMemberTests-1735269541 None] Created reservations ['e329a65d-8773-42b8-b7d9-601d0e676ab1', 'eb04867d-2bfe-4c0b-a114-6c7f89ac4cc3', '9a186c44-a63e-4c08-af23-ee915d3c06ae', '25be79c3-4a4a-4caa-8ed7-faef57754ae0'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-223e7fbb-4881-4d11-b8c6-ad76456a947e tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-223e7fbb-4881-4d11-b8c6-ad76456a947e tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-223e7fbb-4881-4d11-b8c6-ad76456a947e tempest-ProjectMemberTests-1735269541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-223e7fbb-4881-4d11-b8c6-ad76456a947e tempest-ProjectMemberTests-1735269541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-223e7fbb-4881-4d11-b8c6-ad76456a947e tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-223e7fbb-4881-4d11-b8c6-ad76456a947e tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:21 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:57:21 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:21 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1b2731e-5752-4d82-8ffc-dab9b5277df5" returned: 0 in 0.304s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a8c4c3-e3ee-47d0-84aa-69273942aee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1b2731e-5752-4d82-8ffc-dab9b5277df5', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b007c2-1a4f-4e6a-ac52-54dd38861b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:21 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Volume volume-e1b2731e-5752-4d82-8ffc-dab9b5277df5 (e1b2731e-5752-4d82-8ffc-dab9b5277df5): created successfully Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b007c2-1a4f-4e6a-ac52-54dd38861b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Flow 'volume_create_manager' (5772f5aa-45ff-4308-a7c2-ed4eb30cce70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:21 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5165bb20-396e-493f-914f-d2a6bc3eda62 tempest-ProjectReaderTests-1483372431 None] Created volume successfully. Sep 16 17:57:21 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-223e7fbb-4881-4d11-b8c6-ad76456a947e tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.429s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-223e7fbb-4881-4d11-b8c6-ad76456a947e tempest-ProjectMemberTests-1735269541 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:57:21 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-223e7fbb-4881-4d11-b8c6-ad76456a947e tempest-ProjectMemberTests-1735269541 None] Deleted volume successfully. Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-223e7fbb-4881-4d11-b8c6-ad76456a947e tempest-ProjectMemberTests-1735269541 None] Lock "cinder-b4e2b210-6d37-432e-95b1-1bef4a7a1b97-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-02eceef9-d9aa-47b9-8706-3de80559793a tempest-SnapshotDependencyTests-590997139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-02eceef9-d9aa-47b9-8706-3de80559793a tempest-SnapshotDependencyTests-590997139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-02eceef9-d9aa-47b9-8706-3de80559793a tempest-SnapshotDependencyTests-590997139 None] Creating offline snapshot d877a49c-c77a-4356-ba19-488bd0f07027 of volume 05671c17-2d94-4490-86df-8fac0228e9c8 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[40299582-5ad9-44de-9e9b-a2c8f3556598]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-02eceef9-d9aa-47b9-8706-3de80559793a tempest-SnapshotDependencyTests-590997139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:21 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8 Sep 16 17:57:21 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Flow 'volume_create_manager' (9e026e01-3f93-449d-97e7-ed0a784fee76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6bda30-7a1b-4f04-a4c4-5bd24b909111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6bda30-7a1b-4f04-a4c4-5bd24b909111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-366569303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e7b565-25ee-4bcc-a005-34137e43facb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86c45c52eba4c698ff7edf1ea9c075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:57:22Z,use_quota=True,user_id='ff634f34ed8b49ceaa2f8e9b6bee7419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d78efb6-b976-481c-841d-f890d74caa57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d78efb6-b976-481c-841d-f890d74caa57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f40e5b-ec57-4d56-ab63-ddce4f6d9b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f40e5b-ec57-4d56-ab63-ddce4f6d9b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20e7b565-25ee-4bcc-a005-34137e43facb', 'volume_name': 'volume-20e7b565-25ee-4bcc-a005-34137e43facb', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc10a845-25b2-4117-81a9-0e0815a7ecb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc10a845-25b2-4117-81a9-0e0815a7ecb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d53afa-eef6-4b12-86f9-11a32f539ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:21 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Volume 20e7b565-25ee-4bcc-a005-34137e43facb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20e7b565-25ee-4bcc-a005-34137e43facb', 'volume_size': 1} Sep 16 17:57:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:22 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-02eceef9-d9aa-47b9-8706-3de80559793a tempest-SnapshotDependencyTests-590997139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8" returned: 0 in 0.406s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-02eceef9-d9aa-47b9-8706-3de80559793a tempest-SnapshotDependencyTests-590997139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.d877a49c-c77a-4356-ba19-488bd0f07027 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:22 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.d877a49c-c77a-4356-ba19-488bd0f07027 1G Sep 16 17:57:22 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b3e54e31-d1bc-4423-b19a-9d4abc472df1 tempest-ProjectReaderTests-1483372431 None] Acquiring lock "cinder-e1b2731e-5752-4d82-8ffc-dab9b5277df5-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b3e54e31-d1bc-4423-b19a-9d4abc472df1 tempest-ProjectReaderTests-1483372431 None] Lock "cinder-e1b2731e-5752-4d82-8ffc-dab9b5277df5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b3e54e31-d1bc-4423-b19a-9d4abc472df1 tempest-ProjectReaderTests-1483372431 None] Acquiring lock "cinder-quobyte-e1b2731e-5752-4d82-8ffc-dab9b5277df5" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:22 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b3e54e31-d1bc-4423-b19a-9d4abc472df1 tempest-ProjectReaderTests-1483372431 None] Lock "cinder-quobyte-e1b2731e-5752-4d82-8ffc-dab9b5277df5" acquired by "delete_volume" :: waited 0.015s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:22 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[374e0949-42a2-48be-8c7e-70fe95d02fa6]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b3e54e31-d1bc-4423-b19a-9d4abc472df1 tempest-ProjectReaderTests-1483372431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1b2731e-5752-4d82-8ffc-dab9b5277df5 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:22 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1b2731e-5752-4d82-8ffc-dab9b5277df5 Sep 16 17:57:22 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:22 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-02eceef9-d9aa-47b9-8706-3de80559793a tempest-SnapshotDependencyTests-590997139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.d877a49c-c77a-4356-ba19-488bd0f07027 1G" returned: 0 in 0.502s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-02eceef9-d9aa-47b9-8706-3de80559793a tempest-SnapshotDependencyTests-590997139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05671c17-2d94-4490-86df-8fac0228e9c8 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.d877a49c-c77a-4356-ba19-488bd0f07027 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:22 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05671c17-2d94-4490-86df-8fac0228e9c8 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.d877a49c-c77a-4356-ba19-488bd0f07027 Sep 16 17:57:22 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:22 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b3e54e31-d1bc-4423-b19a-9d4abc472df1 tempest-ProjectReaderTests-1483372431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1b2731e-5752-4d82-8ffc-dab9b5277df5" returned: 0 in 0.436s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b3e54e31-d1bc-4423-b19a-9d4abc472df1 tempest-ProjectReaderTests-1483372431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1b2731e-5752-4d82-8ffc-dab9b5277df5 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:22 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1b2731e-5752-4d82-8ffc-dab9b5277df5 Sep 16 17:57:22 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:22 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-02eceef9-d9aa-47b9-8706-3de80559793a tempest-SnapshotDependencyTests-590997139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05671c17-2d94-4490-86df-8fac0228e9c8 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.d877a49c-c77a-4356-ba19-488bd0f07027" returned: 0 in 0.313s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:22 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-02eceef9-d9aa-47b9-8706-3de80559793a tempest-SnapshotDependencyTests-590997139 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.d877a49c-c77a-4356-ba19-488bd0f07027 is being set with open permissions: ugo+rw Sep 16 17:57:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-02eceef9-d9aa-47b9-8706-3de80559793a tempest-SnapshotDependencyTests-590997139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.d877a49c-c77a-4356-ba19-488bd0f07027 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:22 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.d877a49c-c77a-4356-ba19-488bd0f07027 Sep 16 17:57:22 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:23 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b3e54e31-d1bc-4423-b19a-9d4abc472df1 tempest-ProjectReaderTests-1483372431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-e1b2731e-5752-4d82-8ffc-dab9b5277df5" returned: 0 in 0.265s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b3e54e31-d1bc-4423-b19a-9d4abc472df1 tempest-ProjectReaderTests-1483372431 None] Lock "cinder-quobyte-e1b2731e-5752-4d82-8ffc-dab9b5277df5" released by "delete_volume" :: held 0.755s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-b3e54e31-d1bc-4423-b19a-9d4abc472df1 tempest-ProjectReaderTests-1483372431 None] Created reservations ['208cb1a3-7edc-4d39-89f1-bc3e603dd414', '8a82edf0-56d2-414b-a57f-f56016806ff8', 'b19f24e1-fa6c-4671-999b-e3d598d28cc2', 'c0257470-b191-4695-b5f7-f29fb38a1f9e'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b3e54e31-d1bc-4423-b19a-9d4abc472df1 tempest-ProjectReaderTests-1483372431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b3e54e31-d1bc-4423-b19a-9d4abc472df1 tempest-ProjectReaderTests-1483372431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b3e54e31-d1bc-4423-b19a-9d4abc472df1 tempest-ProjectReaderTests-1483372431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:23 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b3e54e31-d1bc-4423-b19a-9d4abc472df1 tempest-ProjectReaderTests-1483372431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b3e54e31-d1bc-4423-b19a-9d4abc472df1 tempest-ProjectReaderTests-1483372431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b3e54e31-d1bc-4423-b19a-9d4abc472df1 tempest-ProjectReaderTests-1483372431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-02eceef9-d9aa-47b9-8706-3de80559793a tempest-SnapshotDependencyTests-590997139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.d877a49c-c77a-4356-ba19-488bd0f07027" returned: 0 in 0.283s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:23 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:57:23 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-02eceef9-d9aa-47b9-8706-3de80559793a tempest-SnapshotDependencyTests-590997139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:23 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.info Sep 16 17:57:23 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:23 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b3e54e31-d1bc-4423-b19a-9d4abc472df1 tempest-ProjectReaderTests-1483372431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.285s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b3e54e31-d1bc-4423-b19a-9d4abc472df1 tempest-ProjectReaderTests-1483372431 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:57:23 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-b3e54e31-d1bc-4423-b19a-9d4abc472df1 tempest-ProjectReaderTests-1483372431 None] Deleted volume successfully. Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b3e54e31-d1bc-4423-b19a-9d4abc472df1 tempest-ProjectReaderTests-1483372431 None] Lock "cinder-e1b2731e-5752-4d82-8ffc-dab9b5277df5-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:23 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-02eceef9-d9aa-47b9-8706-3de80559793a tempest-SnapshotDependencyTests-590997139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.info" returned: 0 in 0.304s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:23 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-02eceef9-d9aa-47b9-8706-3de80559793a tempest-SnapshotDependencyTests-590997139 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.info is being set with open permissions: ugo+rw Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-02eceef9-d9aa-47b9-8706-3de80559793a tempest-SnapshotDependencyTests-590997139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:23 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.info Sep 16 17:57:23 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:23 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-02eceef9-d9aa-47b9-8706-3de80559793a tempest-SnapshotDependencyTests-590997139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.info" returned: 0 in 0.317s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-02eceef9-d9aa-47b9-8706-3de80559793a tempest-SnapshotDependencyTests-590997139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.255s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.960s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-366569303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e7b565-25ee-4bcc-a005-34137e43facb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86c45c52eba4c698ff7edf1ea9c075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:57:22Z,use_quota=True,user_id='ff634f34ed8b49ceaa2f8e9b6bee7419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Creating volume 20e7b565-25ee-4bcc-a005-34137e43facb {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:57:23 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:57:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:23 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb 1073741824 Sep 16 17:57:23 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:23 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-02eceef9-d9aa-47b9-8706-3de80559793a tempest-SnapshotDependencyTests-590997139 None] Create snapshot completed successfully Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Flow 'volume_create_manager' (42374bf5-c624-44ad-b67e-2535dcf1b705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584c65f7-2a9b-4f5f-b6cf-020fb55c3512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584c65f7-2a9b-4f5f-b6cf-020fb55c3512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-564136955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=476a05a4-b8bd-47f9-832f-886d8d7637e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acc44de033a44ae49b32e5c1e0bc6cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:57:24Z,use_quota=True,user_id='1991573cd4144a87b1efd0d93741f87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb0e114-9ee2-48d8-b06a-e2cf5d47174f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb0e114-9ee2-48d8-b06a-e2cf5d47174f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1a0db2-b7ff-492e-bec3-f92e78adc655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1a0db2-b7ff-492e-bec3-f92e78adc655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '476a05a4-b8bd-47f9-832f-886d8d7637e7', 'volume_name': 'volume-476a05a4-b8bd-47f9-832f-886d8d7637e7', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aef9a57-2bd6-44d1-a44f-9323e8ddcb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aef9a57-2bd6-44d1-a44f-9323e8ddcb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7361e7-8812-4f30-a353-1c87b0cf112f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:24 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Volume 476a05a4-b8bd-47f9-832f-886d8d7637e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-476a05a4-b8bd-47f9-832f-886d8d7637e7', 'volume_size': 1} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Flow 'volume_create_manager' (22d002cb-df9f-485e-8f0a-68a1920e6b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4f6d73-3c32-4edd-962b-66a91be696c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4f6d73-3c32-4edd-962b-66a91be696c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1046560609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fbd3dcc-55a1-4783-8dac-840a04b4b3e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4b789bddcb41348d6a1edb0b27ddda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:57:24Z,use_quota=True,user_id='90797b4d598d4280a4e5f75e51387205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66f77bd-b754-4180-ba6f-b10022ad1467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66f77bd-b754-4180-ba6f-b10022ad1467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcbccc94-5958-406d-8078-9e23b12c4629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcbccc94-5958-406d-8078-9e23b12c4629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fbd3dcc-55a1-4783-8dac-840a04b4b3e9', 'volume_name': 'volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5150c0c0-916d-4fbc-89c6-ae6d5be71c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5150c0c0-916d-4fbc-89c6-ae6d5be71c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfceb5ed-f6ca-4c18-b887-3d23a2141679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:24 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Volume 0fbd3dcc-55a1-4783-8dac-840a04b4b3e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9', 'volume_size': 1} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:24 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb 1073741824" returned: 0 in 0.443s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:24 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb Sep 16 17:57:24 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:24 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb" returned: 0 in 0.245s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.405s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-564136955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=476a05a4-b8bd-47f9-832f-886d8d7637e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acc44de033a44ae49b32e5c1e0bc6cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:57:24Z,use_quota=True,user_id='1991573cd4144a87b1efd0d93741f87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Creating volume 476a05a4-b8bd-47f9-832f-886d8d7637e7 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:57:24 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476a05a4-b8bd-47f9-832f-886d8d7637e7 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:24 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476a05a4-b8bd-47f9-832f-886d8d7637e7 1073741824 Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d53afa-eef6-4b12-86f9-11a32f539ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20e7b565-25ee-4bcc-a005-34137e43facb', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:24 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2e95ff-daf3-44f4-8d98-1ff07f695c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:24 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Volume volume-20e7b565-25ee-4bcc-a005-34137e43facb (20e7b565-25ee-4bcc-a005-34137e43facb): created successfully Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2e95ff-daf3-44f4-8d98-1ff07f695c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:24 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Flow 'volume_create_manager' (9e026e01-3f93-449d-97e7-ed0a784fee76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:24 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-b15a4f75-ca7c-4303-852c-d1a920ef4e89 tempest-ProjectMemberTests-1735269541 None] Created volume successfully. Sep 16 17:57:25 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476a05a4-b8bd-47f9-832f-886d8d7637e7 1073741824" returned: 0 in 0.469s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476a05a4-b8bd-47f9-832f-886d8d7637e7 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:25 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476a05a4-b8bd-47f9-832f-886d8d7637e7 Sep 16 17:57:25 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7a864c57-d31d-480f-a09f-9901f04c5a7c tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:25 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476a05a4-b8bd-47f9-832f-886d8d7637e7" returned: 0 in 0.275s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.109s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1046560609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fbd3dcc-55a1-4783-8dac-840a04b4b3e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4b789bddcb41348d6a1edb0b27ddda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:57:24Z,use_quota=True,user_id='90797b4d598d4280a4e5f75e51387205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Creating volume 0fbd3dcc-55a1-4783-8dac-840a04b4b3e9 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:57:25 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7361e7-8812-4f30-a353-1c87b0cf112f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-476a05a4-b8bd-47f9-832f-886d8d7637e7', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:25 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9 1073741824 Sep 16 17:57:25 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4d7564-7de2-4083-9f6e-b3356bf06f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:25 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Volume volume-476a05a4-b8bd-47f9-832f-886d8d7637e7 (476a05a4-b8bd-47f9-832f-886d8d7637e7): created successfully Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4d7564-7de2-4083-9f6e-b3356bf06f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Flow 'volume_create_manager' (42374bf5-c624-44ad-b67e-2535dcf1b705) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:25 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-c323d86b-574f-4ea4-aa4a-a8e8a8a539f6 tempest-ProjectReaderTests-1483372431 None] Created volume successfully. Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Flow 'volume_create_manager' (e39ea139-6cbe-4fe3-8d31-38e7e086e997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671a1d0e-e1b6-416e-901d-f5b8d71d4c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671a1d0e-e1b6-416e-901d-f5b8d71d4c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f75673a-a0c1-4f45-bf60-105f1dc6c6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f877fd6e992c4fa4816ae5c13df3dafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d877a49c-c77a-4356-ba19-488bd0f07027,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:57:26Z,use_quota=True,user_id='f04587632b0047709ddedda79942f948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (085431bc-a9ac-4beb-9da9-4b70d9a12659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (085431bc-a9ac-4beb-9da9-4b70d9a12659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a37f5e2-d8f2-4666-b1fc-66c688e58ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a37f5e2-d8f2-4666-b1fc-66c688e58ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6f75673a-a0c1-4f45-bf60-105f1dc6c6d4', 'volume_name': 'volume-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4', 'volume_size': 1, 'snapshot_id': 'd877a49c-c77a-4356-ba19-488bd0f07027'}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e783c2ff-c7c9-422e-87e1-ee9468186ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e783c2ff-c7c9-422e-87e1-ee9468186ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148870e9-cac6-4daa-a2f1-1da05ff288e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:25 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Volume 6f75673a-a0c1-4f45-bf60-105f1dc6c6d4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4', 'volume_size': 1, 'snapshot_id': 'd877a49c-c77a-4356-ba19-488bd0f07027'} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:25 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9 1073741824" returned: 0 in 0.404s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:25 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9 Sep 16 17:57:25 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c39a1118-9156-4e9b-8cda-e7262a2981b9 tempest-ProjectReaderTests-1483372431 None] Acquiring lock "cinder-476a05a4-b8bd-47f9-832f-886d8d7637e7-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c39a1118-9156-4e9b-8cda-e7262a2981b9 tempest-ProjectReaderTests-1483372431 None] Lock "cinder-476a05a4-b8bd-47f9-832f-886d8d7637e7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:26 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9" returned: 0 in 0.253s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7a864c57-d31d-480f-a09f-9901f04c5a7c tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.853s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfceb5ed-f6ca-4c18-b887-3d23a2141679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8314b4c9-c684-4761-8aba-090a654b9f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-7a864c57-d31d-480f-a09f-9901f04c5a7c tempest-ProjectMemberTests-1735269541 None] Creating offline snapshot 54750926-3f9c-40e7-a4eb-53c4bbb8332f of volume 20e7b565-25ee-4bcc-a005-34137e43facb {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c39a1118-9156-4e9b-8cda-e7262a2981b9 tempest-ProjectReaderTests-1483372431 None] Acquiring lock "cinder-quobyte-476a05a4-b8bd-47f9-832f-886d8d7637e7" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:26 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Volume volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9 (0fbd3dcc-55a1-4783-8dac-840a04b4b3e9): created successfully Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8314b4c9-c684-4761-8aba-090a654b9f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Flow 'volume_create_manager' (22d002cb-df9f-485e-8f0a-68a1920e6b65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c39a1118-9156-4e9b-8cda-e7262a2981b9 tempest-ProjectReaderTests-1483372431 None] Lock "cinder-quobyte-476a05a4-b8bd-47f9-832f-886d8d7637e7" acquired by "delete_volume" :: waited 0.028s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda8bb96-e02e-489a-bbb0-1e273fbe3131]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7a864c57-d31d-480f-a09f-9901f04c5a7c tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a332f2-8140-4598-8d82-02109b27bba3]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c39a1118-9156-4e9b-8cda-e7262a2981b9 tempest-ProjectReaderTests-1483372431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476a05a4-b8bd-47f9-832f-886d8d7637e7 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:26 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-1e33ec54-8501-4c98-b545-95e3e0196d1c tempest-ProjectReaderTests-1000302715 None] Created volume successfully. Sep 16 17:57:26 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb Sep 16 17:57:26 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:26 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476a05a4-b8bd-47f9-832f-886d8d7637e7 Sep 16 17:57:26 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:26 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7a864c57-d31d-480f-a09f-9901f04c5a7c tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb" returned: 0 in 0.403s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7a864c57-d31d-480f-a09f-9901f04c5a7c tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.54750926-3f9c-40e7-a4eb-53c4bbb8332f 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:26 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:26 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.54750926-3f9c-40e7-a4eb-53c4bbb8332f 1G Sep 16 17:57:26 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c39a1118-9156-4e9b-8cda-e7262a2981b9 tempest-ProjectReaderTests-1483372431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476a05a4-b8bd-47f9-832f-886d8d7637e7" returned: 0 in 0.404s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c39a1118-9156-4e9b-8cda-e7262a2981b9 tempest-ProjectReaderTests-1483372431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476a05a4-b8bd-47f9-832f-886d8d7637e7 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:26 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476a05a4-b8bd-47f9-832f-886d8d7637e7 Sep 16 17:57:26 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:26 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c39a1118-9156-4e9b-8cda-e7262a2981b9 tempest-ProjectReaderTests-1483372431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-476a05a4-b8bd-47f9-832f-886d8d7637e7" returned: 0 in 0.244s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c39a1118-9156-4e9b-8cda-e7262a2981b9 tempest-ProjectReaderTests-1483372431 None] Lock "cinder-quobyte-476a05a4-b8bd-47f9-832f-886d8d7637e7" released by "delete_volume" :: held 0.701s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:26 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-c39a1118-9156-4e9b-8cda-e7262a2981b9 tempest-ProjectReaderTests-1483372431 None] Created reservations ['eec97189-00fd-4979-9196-fdcafdb72765', '75f56781-3594-45c8-b0e8-3865aba114d3', '3d81ce8b-c15c-445e-82b5-cf0423fbeb05', '09d709fb-0167-4c27-a8e7-69cc5bedf528'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c39a1118-9156-4e9b-8cda-e7262a2981b9 tempest-ProjectReaderTests-1483372431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c39a1118-9156-4e9b-8cda-e7262a2981b9 tempest-ProjectReaderTests-1483372431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:27 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c39a1118-9156-4e9b-8cda-e7262a2981b9 tempest-ProjectReaderTests-1483372431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:27 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-c39a1118-9156-4e9b-8cda-e7262a2981b9 tempest-ProjectReaderTests-1483372431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c39a1118-9156-4e9b-8cda-e7262a2981b9 tempest-ProjectReaderTests-1483372431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:27 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c39a1118-9156-4e9b-8cda-e7262a2981b9 tempest-ProjectReaderTests-1483372431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7a864c57-d31d-480f-a09f-9901f04c5a7c tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.54750926-3f9c-40e7-a4eb-53c4bbb8332f 1G" returned: 0 in 0.406s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7a864c57-d31d-480f-a09f-9901f04c5a7c tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20e7b565-25ee-4bcc-a005-34137e43facb -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.54750926-3f9c-40e7-a4eb-53c4bbb8332f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:27 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:57:27 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:27 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20e7b565-25ee-4bcc-a005-34137e43facb -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.54750926-3f9c-40e7-a4eb-53c4bbb8332f Sep 16 17:57:27 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:27 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c39a1118-9156-4e9b-8cda-e7262a2981b9 tempest-ProjectReaderTests-1483372431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.268s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:27 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-c39a1118-9156-4e9b-8cda-e7262a2981b9 tempest-ProjectReaderTests-1483372431 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:57:27 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-c39a1118-9156-4e9b-8cda-e7262a2981b9 tempest-ProjectReaderTests-1483372431 None] Deleted volume successfully. Sep 16 17:57:27 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-c39a1118-9156-4e9b-8cda-e7262a2981b9 tempest-ProjectReaderTests-1483372431 None] Lock "cinder-476a05a4-b8bd-47f9-832f-886d8d7637e7-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:27 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7a864c57-d31d-480f-a09f-9901f04c5a7c tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20e7b565-25ee-4bcc-a005-34137e43facb -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.54750926-3f9c-40e7-a4eb-53c4bbb8332f" returned: 0 in 0.389s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:27 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-7a864c57-d31d-480f-a09f-9901f04c5a7c tempest-ProjectMemberTests-1735269541 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.54750926-3f9c-40e7-a4eb-53c4bbb8332f is being set with open permissions: ugo+rw Sep 16 17:57:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7a864c57-d31d-480f-a09f-9901f04c5a7c tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.54750926-3f9c-40e7-a4eb-53c4bbb8332f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:27 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.54750926-3f9c-40e7-a4eb-53c4bbb8332f Sep 16 17:57:27 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c0db531c-3bdc-44be-acc5-bff0476772cb tempest-ProjectReaderTests-1000302715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:27 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7a864c57-d31d-480f-a09f-9901f04c5a7c tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.54750926-3f9c-40e7-a4eb-53c4bbb8332f" returned: 0 in 0.265s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7a864c57-d31d-480f-a09f-9901f04c5a7c tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:27 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.info Sep 16 17:57:27 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:27 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7a864c57-d31d-480f-a09f-9901f04c5a7c tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.info" returned: 0 in 0.268s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:27 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-7a864c57-d31d-480f-a09f-9901f04c5a7c tempest-ProjectMemberTests-1735269541 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.info is being set with open permissions: ugo+rw Sep 16 17:57:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7a864c57-d31d-480f-a09f-9901f04c5a7c tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:28 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.info Sep 16 17:57:28 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:28 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7a864c57-d31d-480f-a09f-9901f04c5a7c tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.info" returned: 0 in 0.277s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7a864c57-d31d-480f-a09f-9901f04c5a7c tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.140s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.625s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Acquiring lock "cinder-quobyte-d877a49c-c77a-4356-ba19-488bd0f07027-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4" by "_create_volume_from_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Lock "cinder-quobyte-d877a49c-c77a-4356-ba19-488bd0f07027-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Creating volume 6f75673a-a0c1-4f45-bf60-105f1dc6c6d4 from snapshot d877a49c-c77a-4356-ba19-488bd0f07027 {{(pid=85899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Acquiring lock "cinder-quobyte-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4" by "_copy_volume_from_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:28 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-7a864c57-d31d-480f-a09f-9901f04c5a7c tempest-ProjectMemberTests-1735269541 None] Create snapshot completed successfully Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Lock "cinder-quobyte-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] snapshot: d877a49c-c77a-4356-ba19-488bd0f07027, volume: 6f75673a-a0c1-4f45-bf60-105f1dc6c6d4, {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-63074bd3-cb1a-4311-aac5-6200057d1a4c tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-54750926-3f9c-40e7-a4eb-53c4bbb8332f-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f8f810-914b-42d1-8c6a-26f1a48d1446]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.d877a49c-c77a-4356-ba19-488bd0f07027 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-63074bd3-cb1a-4311-aac5-6200057d1a4c tempest-ProjectMemberTests-1735269541 None] Lock "cinder-54750926-3f9c-40e7-a4eb-53c4bbb8332f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-63074bd3-cb1a-4311-aac5-6200057d1a4c tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-20e7b565-25ee-4bcc-a005-34137e43facb" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-63074bd3-cb1a-4311-aac5-6200057d1a4c tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-20e7b565-25ee-4bcc-a005-34137e43facb" acquired by "delete_snapshot" :: waited 0.035s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-63074bd3-cb1a-4311-aac5-6200057d1a4c tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-54750926-3f9c-40e7-a4eb-53c4bbb8332f" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-63074bd3-cb1a-4311-aac5-6200057d1a4c tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-54750926-3f9c-40e7-a4eb-53c4bbb8332f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-63074bd3-cb1a-4311-aac5-6200057d1a4c tempest-ProjectMemberTests-1735269541 None] Deleting offline snapshot 54750926-3f9c-40e7-a4eb-53c4bbb8332f of volume 20e7b565-25ee-4bcc-a005-34137e43facb {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-63074bd3-cb1a-4311-aac5-6200057d1a4c tempest-ProjectMemberTests-1735269541 None] snapshot_file for this snap is: volume-20e7b565-25ee-4bcc-a005-34137e43facb.54750926-3f9c-40e7-a4eb-53c4bbb8332f {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:57:28 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.d877a49c-c77a-4356-ba19-488bd0f07027 Sep 16 17:57:28 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c410120-44f6-4ab3-b412-aa813c274eeb]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-63074bd3-cb1a-4311-aac5-6200057d1a4c tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.54750926-3f9c-40e7-a4eb-53c4bbb8332f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:28 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.54750926-3f9c-40e7-a4eb-53c4bbb8332f Sep 16 17:57:28 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:28 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.d877a49c-c77a-4356-ba19-488bd0f07027" returned: 0 in 0.492s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05671c17-2d94-4490-86df-8fac0228e9c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc04fd1-635b-4a9c-a4f3-ece8c7d5792f]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:29 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8 Sep 16 17:57:29 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:29 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-63074bd3-cb1a-4311-aac5-6200057d1a4c tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.54750926-3f9c-40e7-a4eb-53c4bbb8332f" returned: 0 in 0.486s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-63074bd3-cb1a-4311-aac5-6200057d1a4c tempest-ProjectMemberTests-1735269541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20e7b565-25ee-4bcc-a005-34137e43facb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:57:29 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a7bc45-3d34-4c38-91cf-336849827b14]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-63074bd3-cb1a-4311-aac5-6200057d1a4c tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:29 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb Sep 16 17:57:29 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:29 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8" returned: 0 in 0.407s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8 {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 17:57:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Creating direct copy from snapshot {{(pid=85899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 17:57:29 devstack cinder-volume[85899]: DEBUG cinder.utils [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Path /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4 not found in is_blk_device check {{(pid=85899) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 17:57:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:29 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4 Sep 16 17:57:29 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:29 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-63074bd3-cb1a-4311-aac5-6200057d1a4c tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb" returned: 0 in 0.442s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-63074bd3-cb1a-4311-aac5-6200057d1a4c tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.54750926-3f9c-40e7-a4eb-53c4bbb8332f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:29 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.54750926-3f9c-40e7-a4eb-53c4bbb8332f Sep 16 17:57:29 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:30 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-63074bd3-cb1a-4311-aac5-6200057d1a4c tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.54750926-3f9c-40e7-a4eb-53c4bbb8332f" returned: 0 in 0.438s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-63074bd3-cb1a-4311-aac5-6200057d1a4c tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.54750926-3f9c-40e7-a4eb-53c4bbb8332f {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:30 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.54750926-3f9c-40e7-a4eb-53c4bbb8332f Sep 16 17:57:30 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:30 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-63074bd3-cb1a-4311-aac5-6200057d1a4c tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb.54750926-3f9c-40e7-a4eb-53c4bbb8332f" returned: 0 in 0.323s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:30 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-63074bd3-cb1a-4311-aac5-6200057d1a4c tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-54750926-3f9c-40e7-a4eb-53c4bbb8332f" released by "_delete_snapshot" :: held 1.882s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:30 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-63074bd3-cb1a-4311-aac5-6200057d1a4c tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-20e7b565-25ee-4bcc-a005-34137e43facb" released by "delete_snapshot" :: held 1.918s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:30 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-63074bd3-cb1a-4311-aac5-6200057d1a4c tempest-ProjectMemberTests-1735269541 None] Created reservations ['cea7e617-347c-4352-b221-4c460099cd1b', '70d74297-e932-4469-92eb-d140096afeb8', 'bb7514f1-0bc9-4370-aa08-72fe007b89a5', '50eeff5b-4e84-4144-b913-5359e54630da'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:30 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-63074bd3-cb1a-4311-aac5-6200057d1a4c tempest-ProjectMemberTests-1735269541 None] Delete snapshot completed successfully. Sep 16 17:57:30 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-63074bd3-cb1a-4311-aac5-6200057d1a4c tempest-ProjectMemberTests-1735269541 None] Lock "cinder-54750926-3f9c-40e7-a4eb-53c4bbb8332f-delete_snapshot" released by "delete_snapshot" :: held 2.215s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8cf9c923-4b07-4b65-b077-6ed64da8a196 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-20e7b565-25ee-4bcc-a005-34137e43facb-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8cf9c923-4b07-4b65-b077-6ed64da8a196 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-20e7b565-25ee-4bcc-a005-34137e43facb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8cf9c923-4b07-4b65-b077-6ed64da8a196 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-20e7b565-25ee-4bcc-a005-34137e43facb" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:31 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8cf9c923-4b07-4b65-b077-6ed64da8a196 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-20e7b565-25ee-4bcc-a005-34137e43facb" acquired by "delete_volume" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:32 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06831e1-50ca-4667-9041-909ccaf92e00]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8cf9c923-4b07-4b65-b077-6ed64da8a196 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:32 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb Sep 16 17:57:32 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:32 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8cf9c923-4b07-4b65-b077-6ed64da8a196 tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb" returned: 0 in 0.666s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8cf9c923-4b07-4b65-b077-6ed64da8a196 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:32 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb Sep 16 17:57:32 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:33 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8cf9c923-4b07-4b65-b077-6ed64da8a196 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-20e7b565-25ee-4bcc-a005-34137e43facb" returned: 0 in 0.454s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:33 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8cf9c923-4b07-4b65-b077-6ed64da8a196 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-20e7b565-25ee-4bcc-a005-34137e43facb" released by "delete_volume" :: held 1.249s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:33 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-8cf9c923-4b07-4b65-b077-6ed64da8a196 tempest-ProjectMemberTests-1735269541 None] Created reservations ['3f385bef-41a6-4da8-b470-2de7cc5bf07e', '53ddcc73-d7ec-4029-a156-7f528326c386', '0e61d11d-e4c0-4c52-a812-efaa72356c63', '340cd751-9cea-4807-b3d2-3e47d3ca509a'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8cf9c923-4b07-4b65-b077-6ed64da8a196 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8cf9c923-4b07-4b65-b077-6ed64da8a196 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8cf9c923-4b07-4b65-b077-6ed64da8a196 tempest-ProjectMemberTests-1735269541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:33 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8cf9c923-4b07-4b65-b077-6ed64da8a196 tempest-ProjectMemberTests-1735269541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8cf9c923-4b07-4b65-b077-6ed64da8a196 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8cf9c923-4b07-4b65-b077-6ed64da8a196 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:33 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:57:33 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:33 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8cf9c923-4b07-4b65-b077-6ed64da8a196 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.308s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:33 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-8cf9c923-4b07-4b65-b077-6ed64da8a196 tempest-ProjectMemberTests-1735269541 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:57:33 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-8cf9c923-4b07-4b65-b077-6ed64da8a196 tempest-ProjectMemberTests-1735269541 None] Deleted volume successfully. Sep 16 17:57:33 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8cf9c923-4b07-4b65-b077-6ed64da8a196 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-20e7b565-25ee-4bcc-a005-34137e43facb-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:34 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:57:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Flow 'volume_create_manager' (0c3247ac-3787-4862-a9ce-5a001b2d8eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b829edb-818c-4407-ba18-1ecdf1c31b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b829edb-818c-4407-ba18-1ecdf1c31b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-574801231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e14875c-8e42-4c06-a5a1-e7d7b94b44da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86c45c52eba4c698ff7edf1ea9c075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:57:35Z,use_quota=True,user_id='ff634f34ed8b49ceaa2f8e9b6bee7419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8397a555-dbb8-4ec3-982a-5defa92c4ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8397a555-dbb8-4ec3-982a-5defa92c4ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd5b835-f0b8-452e-95be-a475879435d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd5b835-f0b8-452e-95be-a475879435d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e14875c-8e42-4c06-a5a1-e7d7b94b44da', 'volume_name': 'volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dbcd0d8-50ad-49c1-b133-0cd63314c4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dbcd0d8-50ad-49c1-b133-0cd63314c4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:35 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4118e3d-d5db-4ddf-b6e3-42339965e393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:35 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Volume 5e14875c-8e42-4c06-a5a1-e7d7b94b44da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da', 'volume_size': 1} Sep 16 17:57:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:35 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4" returned: 0 in 6.507s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:35 devstack cinder-volume[85899]: DEBUG cinder.image.image_utils [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Image conversion details: src /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8, size 1024.00 MB, duration 6.51 sec, destination /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4 {{(pid=85899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 17:57:35 devstack cinder-volume[85899]: INFO cinder.image.image_utils [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Converted 1024.00 MB image at 157.34 MB/s Sep 16 17:57:35 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4 is being set with open permissions: ugo+rw Sep 16 17:57:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:35 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4 Sep 16 17:57:35 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:36 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4" returned: 0 in 0.236s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Lock "cinder-quobyte-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4" released by "_copy_volume_from_snapshot" :: held 7.769s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Lock "cinder-quobyte-d877a49c-c77a-4356-ba19-488bd0f07027-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4" released by "_create_volume_from_snapshot" :: held 7.850s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.878s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c0db531c-3bdc-44be-acc5-bff0476772cb tempest-ProjectReaderTests-1000302715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.695s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-c0db531c-3bdc-44be-acc5-bff0476772cb tempest-ProjectReaderTests-1000302715 None] Creating offline snapshot 4a24b1d9-b557-45ec-be5b-dc3375d3487e of volume 0fbd3dcc-55a1-4783-8dac-840a04b4b3e9 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148870e9-cac6-4daa-a2f1-1da05ff288e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4', 'volume_size': 1, 'snapshot_id': 'd877a49c-c77a-4356-ba19-488bd0f07027'}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1adc96fe-2e4a-44a1-9a3a-0fc3523976d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a504c4-ec53-4b03-87ff-26537f4071bc]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c0db531c-3bdc-44be-acc5-bff0476772cb tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:36 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Volume volume-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4 (6f75673a-a0c1-4f45-bf60-105f1dc6c6d4): created successfully Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1adc96fe-2e4a-44a1-9a3a-0fc3523976d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Flow 'volume_create_manager' (e39ea139-6cbe-4fe3-8d31-38e7e086e997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:36 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5e7a3886-e705-4695-8479-d11170354acb tempest-SnapshotDependencyTests-590997139 None] Created volume successfully. Sep 16 17:57:36 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9 Sep 16 17:57:36 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3037b8b4-0d7b-40c8-8b61-28e76a788514 tempest-SnapshotDependencyTests-590997139 None] Acquiring lock "cinder-d877a49c-c77a-4356-ba19-488bd0f07027-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3037b8b4-0d7b-40c8-8b61-28e76a788514 tempest-SnapshotDependencyTests-590997139 None] Lock "cinder-d877a49c-c77a-4356-ba19-488bd0f07027-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3037b8b4-0d7b-40c8-8b61-28e76a788514 tempest-SnapshotDependencyTests-590997139 None] Acquiring lock "cinder-quobyte-05671c17-2d94-4490-86df-8fac0228e9c8" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3037b8b4-0d7b-40c8-8b61-28e76a788514 tempest-SnapshotDependencyTests-590997139 None] Lock "cinder-quobyte-05671c17-2d94-4490-86df-8fac0228e9c8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3037b8b4-0d7b-40c8-8b61-28e76a788514 tempest-SnapshotDependencyTests-590997139 None] Acquiring lock "cinder-quobyte-d877a49c-c77a-4356-ba19-488bd0f07027" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3037b8b4-0d7b-40c8-8b61-28e76a788514 tempest-SnapshotDependencyTests-590997139 None] Lock "cinder-quobyte-d877a49c-c77a-4356-ba19-488bd0f07027" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-3037b8b4-0d7b-40c8-8b61-28e76a788514 tempest-SnapshotDependencyTests-590997139 None] Deleting offline snapshot d877a49c-c77a-4356-ba19-488bd0f07027 of volume 05671c17-2d94-4490-86df-8fac0228e9c8 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-3037b8b4-0d7b-40c8-8b61-28e76a788514 tempest-SnapshotDependencyTests-590997139 None] snapshot_file for this snap is: volume-05671c17-2d94-4490-86df-8fac0228e9c8.d877a49c-c77a-4356-ba19-488bd0f07027 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c67898-8f98-4242-92ee-ae8630614129]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3037b8b4-0d7b-40c8-8b61-28e76a788514 tempest-SnapshotDependencyTests-590997139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.d877a49c-c77a-4356-ba19-488bd0f07027 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:36 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c0db531c-3bdc-44be-acc5-bff0476772cb tempest-ProjectReaderTests-1000302715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9" returned: 0 in 0.391s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c0db531c-3bdc-44be-acc5-bff0476772cb tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.4a24b1d9-b557-45ec-be5b-dc3375d3487e 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:36 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.4a24b1d9-b557-45ec-be5b-dc3375d3487e 1G Sep 16 17:57:36 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:36 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.d877a49c-c77a-4356-ba19-488bd0f07027 Sep 16 17:57:36 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:36 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3037b8b4-0d7b-40c8-8b61-28e76a788514 tempest-SnapshotDependencyTests-590997139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.d877a49c-c77a-4356-ba19-488bd0f07027" returned: 0 in 0.377s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-3037b8b4-0d7b-40c8-8b61-28e76a788514 tempest-SnapshotDependencyTests-590997139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05671c17-2d94-4490-86df-8fac0228e9c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[559cc373-9c23-4954-80ef-287855fd0672]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3037b8b4-0d7b-40c8-8b61-28e76a788514 tempest-SnapshotDependencyTests-590997139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:37 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c0db531c-3bdc-44be-acc5-bff0476772cb tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.4a24b1d9-b557-45ec-be5b-dc3375d3487e 1G" returned: 0 in 0.438s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c0db531c-3bdc-44be-acc5-bff0476772cb tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.4a24b1d9-b557-45ec-be5b-dc3375d3487e {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:37 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.4a24b1d9-b557-45ec-be5b-dc3375d3487e Sep 16 17:57:37 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:37 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8 Sep 16 17:57:37 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:37 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c0db531c-3bdc-44be-acc5-bff0476772cb tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.4a24b1d9-b557-45ec-be5b-dc3375d3487e" returned: 0 in 0.273s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:37 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-c0db531c-3bdc-44be-acc5-bff0476772cb tempest-ProjectReaderTests-1000302715 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.4a24b1d9-b557-45ec-be5b-dc3375d3487e is being set with open permissions: ugo+rw Sep 16 17:57:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c0db531c-3bdc-44be-acc5-bff0476772cb tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.4a24b1d9-b557-45ec-be5b-dc3375d3487e {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:37 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.4a24b1d9-b557-45ec-be5b-dc3375d3487e Sep 16 17:57:37 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:37 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3037b8b4-0d7b-40c8-8b61-28e76a788514 tempest-SnapshotDependencyTests-590997139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8" returned: 0 in 0.529s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3037b8b4-0d7b-40c8-8b61-28e76a788514 tempest-SnapshotDependencyTests-590997139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.d877a49c-c77a-4356-ba19-488bd0f07027 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:37 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.d877a49c-c77a-4356-ba19-488bd0f07027 Sep 16 17:57:37 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:37 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c0db531c-3bdc-44be-acc5-bff0476772cb tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.4a24b1d9-b557-45ec-be5b-dc3375d3487e" returned: 0 in 0.248s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c0db531c-3bdc-44be-acc5-bff0476772cb tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:37 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.info Sep 16 17:57:37 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:37 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3037b8b4-0d7b-40c8-8b61-28e76a788514 tempest-SnapshotDependencyTests-590997139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.d877a49c-c77a-4356-ba19-488bd0f07027" returned: 0 in 0.340s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3037b8b4-0d7b-40c8-8b61-28e76a788514 tempest-SnapshotDependencyTests-590997139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.d877a49c-c77a-4356-ba19-488bd0f07027 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:37 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.d877a49c-c77a-4356-ba19-488bd0f07027 Sep 16 17:57:37 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:37 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c0db531c-3bdc-44be-acc5-bff0476772cb tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.info" returned: 0 in 0.265s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:37 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-c0db531c-3bdc-44be-acc5-bff0476772cb tempest-ProjectReaderTests-1000302715 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.info is being set with open permissions: ugo+rw Sep 16 17:57:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c0db531c-3bdc-44be-acc5-bff0476772cb tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:37 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.info Sep 16 17:57:37 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:38 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3037b8b4-0d7b-40c8-8b61-28e76a788514 tempest-SnapshotDependencyTests-590997139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8.d877a49c-c77a-4356-ba19-488bd0f07027" returned: 0 in 0.252s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:38 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-c0db531c-3bdc-44be-acc5-bff0476772cb tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.info" returned: 0 in 0.261s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-c0db531c-3bdc-44be-acc5-bff0476772cb tempest-ProjectReaderTests-1000302715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.970s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3037b8b4-0d7b-40c8-8b61-28e76a788514 tempest-SnapshotDependencyTests-590997139 None] Lock "cinder-quobyte-d877a49c-c77a-4356-ba19-488bd0f07027" released by "_delete_snapshot" :: held 1.633s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.042s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-574801231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e14875c-8e42-4c06-a5a1-e7d7b94b44da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86c45c52eba4c698ff7edf1ea9c075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:57:35Z,use_quota=True,user_id='ff634f34ed8b49ceaa2f8e9b6bee7419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Creating volume 5e14875c-8e42-4c06-a5a1-e7d7b94b44da {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:57:38 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3037b8b4-0d7b-40c8-8b61-28e76a788514 tempest-SnapshotDependencyTests-590997139 None] Lock "cinder-quobyte-05671c17-2d94-4490-86df-8fac0228e9c8" released by "delete_snapshot" :: held 1.686s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:38 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da 1073741824 Sep 16 17:57:38 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:38 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-c0db531c-3bdc-44be-acc5-bff0476772cb tempest-ProjectReaderTests-1000302715 None] Create snapshot completed successfully Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-3037b8b4-0d7b-40c8-8b61-28e76a788514 tempest-SnapshotDependencyTests-590997139 None] Created reservations ['5877728b-626d-4cca-acb8-72c36cff2963', '8918d0e1-27a3-4809-80be-c87e75ac7ede', 'fb336236-0b92-410f-bc3a-01b821ed8b26', '753b0c1f-6756-46f8-ad89-7db83a550579'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:38 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-3037b8b4-0d7b-40c8-8b61-28e76a788514 tempest-SnapshotDependencyTests-590997139 None] Delete snapshot completed successfully. Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-3037b8b4-0d7b-40c8-8b61-28e76a788514 tempest-SnapshotDependencyTests-590997139 None] Lock "cinder-d877a49c-c77a-4356-ba19-488bd0f07027-delete_snapshot" released by "delete_snapshot" :: held 1.824s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:38 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da 1073741824" returned: 0 in 0.403s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:38 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da Sep 16 17:57:38 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d6208ee5-fcaa-496e-a3f2-cbe098844fb0 tempest-SnapshotDependencyTests-590997139 None] Acquiring lock "cinder-05671c17-2d94-4490-86df-8fac0228e9c8-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d6208ee5-fcaa-496e-a3f2-cbe098844fb0 tempest-SnapshotDependencyTests-590997139 None] Lock "cinder-05671c17-2d94-4490-86df-8fac0228e9c8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d6208ee5-fcaa-496e-a3f2-cbe098844fb0 tempest-SnapshotDependencyTests-590997139 None] Acquiring lock "cinder-quobyte-05671c17-2d94-4490-86df-8fac0228e9c8" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d6208ee5-fcaa-496e-a3f2-cbe098844fb0 tempest-SnapshotDependencyTests-590997139 None] Lock "cinder-quobyte-05671c17-2d94-4490-86df-8fac0228e9c8" acquired by "delete_volume" :: waited 0.015s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9ee235-4723-456f-b8c8-4831a6e8e26c]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d6208ee5-fcaa-496e-a3f2-cbe098844fb0 tempest-SnapshotDependencyTests-590997139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:38 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da" returned: 0 in 0.244s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4118e3d-d5db-4ddf-b6e3-42339965e393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9209d848-826f-4685-8fc3-b0e083d2096e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:38 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8 Sep 16 17:57:38 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:38 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Volume volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da (5e14875c-8e42-4c06-a5a1-e7d7b94b44da): created successfully Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9209d848-826f-4685-8fc3-b0e083d2096e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:38 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Flow 'volume_create_manager' (0c3247ac-3787-4862-a9ce-5a001b2d8eb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:38 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-a0906b89-6f5e-4f8f-8ca5-92d273d7a19b tempest-ProjectMemberTests-1735269541 None] Created volume successfully. Sep 16 17:57:39 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d6208ee5-fcaa-496e-a3f2-cbe098844fb0 tempest-SnapshotDependencyTests-590997139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8" returned: 0 in 0.372s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d6208ee5-fcaa-496e-a3f2-cbe098844fb0 tempest-SnapshotDependencyTests-590997139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:39 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8 Sep 16 17:57:39 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-00738bdb-3fce-47bd-a598-fc30407051ee tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-4a24b1d9-b557-45ec-be5b-dc3375d3487e-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-00738bdb-3fce-47bd-a598-fc30407051ee tempest-ProjectReaderTests-1000302715 None] Lock "cinder-4a24b1d9-b557-45ec-be5b-dc3375d3487e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-00738bdb-3fce-47bd-a598-fc30407051ee tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-quobyte-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-00738bdb-3fce-47bd-a598-fc30407051ee tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-00738bdb-3fce-47bd-a598-fc30407051ee tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-quobyte-4a24b1d9-b557-45ec-be5b-dc3375d3487e" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-feebb969-2750-4c4c-bbd2-fa894ea5e22d tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-feebb969-2750-4c4c-bbd2-fa894ea5e22d tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-00738bdb-3fce-47bd-a598-fc30407051ee tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-4a24b1d9-b557-45ec-be5b-dc3375d3487e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-00738bdb-3fce-47bd-a598-fc30407051ee tempest-ProjectReaderTests-1000302715 None] Deleting offline snapshot 4a24b1d9-b557-45ec-be5b-dc3375d3487e of volume 0fbd3dcc-55a1-4783-8dac-840a04b4b3e9 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:57:39 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-00738bdb-3fce-47bd-a598-fc30407051ee tempest-ProjectReaderTests-1000302715 None] snapshot_file for this snap is: volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.4a24b1d9-b557-45ec-be5b-dc3375d3487e {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-feebb969-2750-4c4c-bbd2-fa894ea5e22d tempest-ProjectMemberTests-1735269541 None] Creating offline snapshot 0b72f9f7-6517-440d-bff8-90530d9ad85c of volume 5e14875c-8e42-4c06-a5a1-e7d7b94b44da {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d6208ee5-fcaa-496e-a3f2-cbe098844fb0 tempest-SnapshotDependencyTests-590997139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-05671c17-2d94-4490-86df-8fac0228e9c8" returned: 0 in 0.334s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd017ce2-acd3-4afa-a468-d44d63b2652e]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb850ff-7beb-4a60-a614-2a3d8c71b760]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00738bdb-3fce-47bd-a598-fc30407051ee tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.4a24b1d9-b557-45ec-be5b-dc3375d3487e {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-feebb969-2750-4c4c-bbd2-fa894ea5e22d tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d6208ee5-fcaa-496e-a3f2-cbe098844fb0 tempest-SnapshotDependencyTests-590997139 None] Lock "cinder-quobyte-05671c17-2d94-4490-86df-8fac0228e9c8" released by "delete_volume" :: held 0.792s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-d6208ee5-fcaa-496e-a3f2-cbe098844fb0 tempest-SnapshotDependencyTests-590997139 None] Created reservations ['3be1374f-ec3b-4d85-94ec-b510284e2a7c', '4fc7d121-75ab-4901-bc13-4afc46c1f409', 'a3d3ded2-e4bb-439d-ab22-f87abde680bd', '0420f56c-26bb-458a-9f8b-7305f00154ce'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:39 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.4a24b1d9-b557-45ec-be5b-dc3375d3487e Sep 16 17:57:39 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da Sep 16 17:57:39 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:39 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d6208ee5-fcaa-496e-a3f2-cbe098844fb0 tempest-SnapshotDependencyTests-590997139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d6208ee5-fcaa-496e-a3f2-cbe098844fb0 tempest-SnapshotDependencyTests-590997139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d6208ee5-fcaa-496e-a3f2-cbe098844fb0 tempest-SnapshotDependencyTests-590997139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-d6208ee5-fcaa-496e-a3f2-cbe098844fb0 tempest-SnapshotDependencyTests-590997139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-d6208ee5-fcaa-496e-a3f2-cbe098844fb0 tempest-SnapshotDependencyTests-590997139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d6208ee5-fcaa-496e-a3f2-cbe098844fb0 tempest-SnapshotDependencyTests-590997139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:39 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:57:39 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-908883ae-9550-4d65-b484-d37c5cebad6c tempest-SnapshotDependencyTests-590997139 None] Acquiring lock "cinder-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-908883ae-9550-4d65-b484-d37c5cebad6c tempest-SnapshotDependencyTests-590997139 None] Lock "cinder-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-908883ae-9550-4d65-b484-d37c5cebad6c tempest-SnapshotDependencyTests-590997139 None] Acquiring lock "cinder-quobyte-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:39 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:39 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00738bdb-3fce-47bd-a598-fc30407051ee tempest-ProjectReaderTests-1000302715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.4a24b1d9-b557-45ec-be5b-dc3375d3487e" returned: 0 in 0.439s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-00738bdb-3fce-47bd-a598-fc30407051ee tempest-ProjectReaderTests-1000302715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:57:39 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-908883ae-9550-4d65-b484-d37c5cebad6c tempest-SnapshotDependencyTests-590997139 None] Lock "cinder-quobyte-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4" acquired by "delete_volume" :: waited 0.044s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2286a21-8ee1-4413-95a1-a49aefb3b571]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00738bdb-3fce-47bd-a598-fc30407051ee tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-d6208ee5-fcaa-496e-a3f2-cbe098844fb0 tempest-SnapshotDependencyTests-590997139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.326s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-feebb969-2750-4c4c-bbd2-fa894ea5e22d tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da" returned: 0 in 0.480s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-d6208ee5-fcaa-496e-a3f2-cbe098844fb0 tempest-SnapshotDependencyTests-590997139 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-feebb969-2750-4c4c-bbd2-fa894ea5e22d tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.0b72f9f7-6517-440d-bff8-90530d9ad85c 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cd0ae7-95c4-401e-9911-23b8c3d5878f]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-908883ae-9550-4d65-b484-d37c5cebad6c tempest-SnapshotDependencyTests-590997139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:39 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.0b72f9f7-6517-440d-bff8-90530d9ad85c 1G Sep 16 17:57:39 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-d6208ee5-fcaa-496e-a3f2-cbe098844fb0 tempest-SnapshotDependencyTests-590997139 None] Deleted volume successfully. Sep 16 17:57:39 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:40 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-d6208ee5-fcaa-496e-a3f2-cbe098844fb0 tempest-SnapshotDependencyTests-590997139 None] Lock "cinder-05671c17-2d94-4490-86df-8fac0228e9c8-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:40 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9 Sep 16 17:57:40 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:40 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4 Sep 16 17:57:40 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:40 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00738bdb-3fce-47bd-a598-fc30407051ee tempest-ProjectReaderTests-1000302715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9" returned: 0 in 0.373s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00738bdb-3fce-47bd-a598-fc30407051ee tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.4a24b1d9-b557-45ec-be5b-dc3375d3487e {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:40 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.4a24b1d9-b557-45ec-be5b-dc3375d3487e Sep 16 17:57:40 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:40 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-908883ae-9550-4d65-b484-d37c5cebad6c tempest-SnapshotDependencyTests-590997139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4" returned: 0 in 0.389s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-908883ae-9550-4d65-b484-d37c5cebad6c tempest-SnapshotDependencyTests-590997139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:40 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4 Sep 16 17:57:40 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:40 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-feebb969-2750-4c4c-bbd2-fa894ea5e22d tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.0b72f9f7-6517-440d-bff8-90530d9ad85c 1G" returned: 0 in 0.461s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-feebb969-2750-4c4c-bbd2-fa894ea5e22d tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.0b72f9f7-6517-440d-bff8-90530d9ad85c {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:40 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.0b72f9f7-6517-440d-bff8-90530d9ad85c Sep 16 17:57:40 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:40 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-908883ae-9550-4d65-b484-d37c5cebad6c tempest-SnapshotDependencyTests-590997139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4" returned: 0 in 0.277s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:40 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-908883ae-9550-4d65-b484-d37c5cebad6c tempest-SnapshotDependencyTests-590997139 None] Lock "cinder-quobyte-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4" released by "delete_volume" :: held 0.726s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:40 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00738bdb-3fce-47bd-a598-fc30407051ee tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.4a24b1d9-b557-45ec-be5b-dc3375d3487e" returned: 0 in 0.381s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00738bdb-3fce-47bd-a598-fc30407051ee tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.4a24b1d9-b557-45ec-be5b-dc3375d3487e {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:40 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-908883ae-9550-4d65-b484-d37c5cebad6c tempest-SnapshotDependencyTests-590997139 None] Created reservations ['ab492d2e-148d-4929-97cd-b1ba96a35ab4', 'a138013f-43b0-4ca0-9406-0be10800cbd1', '76de40c6-7c55-4ef4-ae41-379ff42274a8', '9892e046-c7d7-4f13-bb43-a7dbd6aac5b6'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:40 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.4a24b1d9-b557-45ec-be5b-dc3375d3487e Sep 16 17:57:40 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:40 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-feebb969-2750-4c4c-bbd2-fa894ea5e22d tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.0b72f9f7-6517-440d-bff8-90530d9ad85c" returned: 0 in 0.330s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:40 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-feebb969-2750-4c4c-bbd2-fa894ea5e22d tempest-ProjectMemberTests-1735269541 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.0b72f9f7-6517-440d-bff8-90530d9ad85c is being set with open permissions: ugo+rw Sep 16 17:57:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-feebb969-2750-4c4c-bbd2-fa894ea5e22d tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.0b72f9f7-6517-440d-bff8-90530d9ad85c {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:40 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.0b72f9f7-6517-440d-bff8-90530d9ad85c Sep 16 17:57:40 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-908883ae-9550-4d65-b484-d37c5cebad6c tempest-SnapshotDependencyTests-590997139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-908883ae-9550-4d65-b484-d37c5cebad6c tempest-SnapshotDependencyTests-590997139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-908883ae-9550-4d65-b484-d37c5cebad6c tempest-SnapshotDependencyTests-590997139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-908883ae-9550-4d65-b484-d37c5cebad6c tempest-SnapshotDependencyTests-590997139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-908883ae-9550-4d65-b484-d37c5cebad6c tempest-SnapshotDependencyTests-590997139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-908883ae-9550-4d65-b484-d37c5cebad6c tempest-SnapshotDependencyTests-590997139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:40 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:57:40 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:40 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-00738bdb-3fce-47bd-a598-fc30407051ee tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9.4a24b1d9-b557-45ec-be5b-dc3375d3487e" returned: 0 in 0.295s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:41 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-feebb969-2750-4c4c-bbd2-fa894ea5e22d tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.0b72f9f7-6517-440d-bff8-90530d9ad85c" returned: 0 in 0.278s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-00738bdb-3fce-47bd-a598-fc30407051ee tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-4a24b1d9-b557-45ec-be5b-dc3375d3487e" released by "_delete_snapshot" :: held 1.624s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-00738bdb-3fce-47bd-a598-fc30407051ee tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9" released by "delete_snapshot" :: held 1.661s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-feebb969-2750-4c4c-bbd2-fa894ea5e22d tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:41 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-908883ae-9550-4d65-b484-d37c5cebad6c tempest-SnapshotDependencyTests-590997139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.280s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:41 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-908883ae-9550-4d65-b484-d37c5cebad6c tempest-SnapshotDependencyTests-590997139 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:57:41 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.info Sep 16 17:57:41 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:41 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-908883ae-9550-4d65-b484-d37c5cebad6c tempest-SnapshotDependencyTests-590997139 None] Deleted volume successfully. Sep 16 17:57:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-908883ae-9550-4d65-b484-d37c5cebad6c tempest-SnapshotDependencyTests-590997139 None] Lock "cinder-6f75673a-a0c1-4f45-bf60-105f1dc6c6d4-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:41 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-00738bdb-3fce-47bd-a598-fc30407051ee tempest-ProjectReaderTests-1000302715 None] Created reservations ['275db193-d0ab-4785-a7b3-01319a867569', 'ab7c7377-c34d-4a57-ac91-1707603dd392', '4bbb7624-83ee-40d9-a84d-829dafec9f90', 'df7d94cc-e857-4b8c-905b-f6f8396c76d0'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:41 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-00738bdb-3fce-47bd-a598-fc30407051ee tempest-ProjectReaderTests-1000302715 None] Delete snapshot completed successfully. Sep 16 17:57:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-00738bdb-3fce-47bd-a598-fc30407051ee tempest-ProjectReaderTests-1000302715 None] Lock "cinder-4a24b1d9-b557-45ec-be5b-dc3375d3487e-delete_snapshot" released by "delete_snapshot" :: held 1.861s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:41 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-feebb969-2750-4c4c-bbd2-fa894ea5e22d tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.info" returned: 0 in 0.265s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:41 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-feebb969-2750-4c4c-bbd2-fa894ea5e22d tempest-ProjectMemberTests-1735269541 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.info is being set with open permissions: ugo+rw Sep 16 17:57:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-feebb969-2750-4c4c-bbd2-fa894ea5e22d tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:41 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.info Sep 16 17:57:41 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8f0f336e-b4d8-4caa-af2d-7da27127078d tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8f0f336e-b4d8-4caa-af2d-7da27127078d tempest-ProjectReaderTests-1000302715 None] Lock "cinder-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8f0f336e-b4d8-4caa-af2d-7da27127078d tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-quobyte-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:41 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-feebb969-2750-4c4c-bbd2-fa894ea5e22d tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.info" returned: 0 in 0.276s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-feebb969-2750-4c4c-bbd2-fa894ea5e22d tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.241s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:41 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8f0f336e-b4d8-4caa-af2d-7da27127078d tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9" acquired by "delete_volume" :: waited 0.044s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:41 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fe89df-fddc-4d2f-9561-b544b5e39f88]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:41 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8f0f336e-b4d8-4caa-af2d-7da27127078d tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:41 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-feebb969-2750-4c4c-bbd2-fa894ea5e22d tempest-ProjectMemberTests-1735269541 None] Create snapshot completed successfully Sep 16 17:57:41 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9 Sep 16 17:57:41 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:42 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8f0f336e-b4d8-4caa-af2d-7da27127078d tempest-ProjectReaderTests-1000302715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9" returned: 0 in 0.384s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8f0f336e-b4d8-4caa-af2d-7da27127078d tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:42 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9 Sep 16 17:57:42 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:42 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8f0f336e-b4d8-4caa-af2d-7da27127078d tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9" returned: 0 in 0.260s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8f0f336e-b4d8-4caa-af2d-7da27127078d tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9" released by "delete_volume" :: held 0.717s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-8f0f336e-b4d8-4caa-af2d-7da27127078d tempest-ProjectReaderTests-1000302715 None] Created reservations ['54e7ae8c-7d80-408a-8856-45fe39a049c8', '567f84a6-4062-48ed-9b94-dfe100b3ab70', 'e53d62c4-e52b-457f-8c6f-bdfe2d879b27', '8c5c6ec2-e73d-4c72-93bb-bbaf04ffdf51'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8f0f336e-b4d8-4caa-af2d-7da27127078d tempest-ProjectReaderTests-1000302715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8f0f336e-b4d8-4caa-af2d-7da27127078d tempest-ProjectReaderTests-1000302715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8f0f336e-b4d8-4caa-af2d-7da27127078d tempest-ProjectReaderTests-1000302715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-8f0f336e-b4d8-4caa-af2d-7da27127078d tempest-ProjectReaderTests-1000302715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-8f0f336e-b4d8-4caa-af2d-7da27127078d tempest-ProjectReaderTests-1000302715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8f0f336e-b4d8-4caa-af2d-7da27127078d tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:42 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:57:42 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5b4632fe-e386-4d44-a79f-dd1fc735d33c tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-0b72f9f7-6517-440d-bff8-90530d9ad85c-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5b4632fe-e386-4d44-a79f-dd1fc735d33c tempest-ProjectMemberTests-1735269541 None] Lock "cinder-0b72f9f7-6517-440d-bff8-90530d9ad85c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5b4632fe-e386-4d44-a79f-dd1fc735d33c tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-5e14875c-8e42-4c06-a5a1-e7d7b94b44da" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5b4632fe-e386-4d44-a79f-dd1fc735d33c tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-5e14875c-8e42-4c06-a5a1-e7d7b94b44da" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5b4632fe-e386-4d44-a79f-dd1fc735d33c tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-0b72f9f7-6517-440d-bff8-90530d9ad85c" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5b4632fe-e386-4d44-a79f-dd1fc735d33c tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-0b72f9f7-6517-440d-bff8-90530d9ad85c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5b4632fe-e386-4d44-a79f-dd1fc735d33c tempest-ProjectMemberTests-1735269541 None] Deleting offline snapshot 0b72f9f7-6517-440d-bff8-90530d9ad85c of volume 5e14875c-8e42-4c06-a5a1-e7d7b94b44da {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5b4632fe-e386-4d44-a79f-dd1fc735d33c tempest-ProjectMemberTests-1735269541 None] snapshot_file for this snap is: volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.0b72f9f7-6517-440d-bff8-90530d9ad85c {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dac3bbd-8d14-49bf-b47d-26e2daed86a1]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5b4632fe-e386-4d44-a79f-dd1fc735d33c tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.0b72f9f7-6517-440d-bff8-90530d9ad85c {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:42 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-8f0f336e-b4d8-4caa-af2d-7da27127078d tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.308s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-8f0f336e-b4d8-4caa-af2d-7da27127078d tempest-ProjectReaderTests-1000302715 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:57:42 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-8f0f336e-b4d8-4caa-af2d-7da27127078d tempest-ProjectReaderTests-1000302715 None] Deleted volume successfully. Sep 16 17:57:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-8f0f336e-b4d8-4caa-af2d-7da27127078d tempest-ProjectReaderTests-1000302715 None] Lock "cinder-0fbd3dcc-55a1-4783-8dac-840a04b4b3e9-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:42 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.0b72f9f7-6517-440d-bff8-90530d9ad85c Sep 16 17:57:42 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:43 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5b4632fe-e386-4d44-a79f-dd1fc735d33c tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.0b72f9f7-6517-440d-bff8-90530d9ad85c" returned: 0 in 0.429s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5b4632fe-e386-4d44-a79f-dd1fc735d33c tempest-ProjectMemberTests-1735269541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[683c43aa-dab1-4511-b329-6c12f3592608]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5b4632fe-e386-4d44-a79f-dd1fc735d33c tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Flow 'volume_create_manager' (78d6536d-0dbb-45e3-a1c7-bcf4cecb2fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a23471-c3b4-4068-8ce7-aa1ba2aa42eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a23471-c3b4-4068-8ce7-aa1ba2aa42eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1957110841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158fab0e-94d4-4e47-98c1-42a43a3b5df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4b789bddcb41348d6a1edb0b27ddda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:57:43Z,use_quota=True,user_id='90797b4d598d4280a4e5f75e51387205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535163d6-d57d-4a6f-a6c8-cd28e63aa2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:43 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da Sep 16 17:57:43 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535163d6-d57d-4a6f-a6c8-cd28e63aa2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64590dec-5482-4698-b4ef-196df3f0eb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64590dec-5482-4698-b4ef-196df3f0eb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '158fab0e-94d4-4e47-98c1-42a43a3b5df9', 'volume_name': 'volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb45217-23a6-4dc8-b5b5-53ffff06df84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb45217-23a6-4dc8-b5b5-53ffff06df84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fae7dc3-d542-4407-8e09-aff429e1daba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:43 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Volume 158fab0e-94d4-4e47-98c1-42a43a3b5df9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9', 'volume_size': 1} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1957110841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158fab0e-94d4-4e47-98c1-42a43a3b5df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4b789bddcb41348d6a1edb0b27ddda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:57:43Z,use_quota=True,user_id='90797b4d598d4280a4e5f75e51387205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Creating volume 158fab0e-94d4-4e47-98c1-42a43a3b5df9 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:57:43 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:43 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9 1073741824 Sep 16 17:57:43 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:43 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5b4632fe-e386-4d44-a79f-dd1fc735d33c tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da" returned: 0 in 0.392s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5b4632fe-e386-4d44-a79f-dd1fc735d33c tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.0b72f9f7-6517-440d-bff8-90530d9ad85c {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:43 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.0b72f9f7-6517-440d-bff8-90530d9ad85c Sep 16 17:57:43 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:43 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9 1073741824" returned: 0 in 0.511s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:43 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9 Sep 16 17:57:43 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:43 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5b4632fe-e386-4d44-a79f-dd1fc735d33c tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.0b72f9f7-6517-440d-bff8-90530d9ad85c" returned: 0 in 0.392s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5b4632fe-e386-4d44-a79f-dd1fc735d33c tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.0b72f9f7-6517-440d-bff8-90530d9ad85c {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:44 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.0b72f9f7-6517-440d-bff8-90530d9ad85c Sep 16 17:57:44 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:44 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9" returned: 0 in 0.276s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:57:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fae7dc3-d542-4407-8e09-aff429e1daba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (719a52f0-484d-463f-8e5c-4f81442fcc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:44 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Volume volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9 (158fab0e-94d4-4e47-98c1-42a43a3b5df9): created successfully Sep 16 17:57:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (719a52f0-484d-463f-8e5c-4f81442fcc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Flow 'volume_create_manager' (78d6536d-0dbb-45e3-a1c7-bcf4cecb2fd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:44 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:44 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-16cab900-5312-4e5f-a48d-eeef653daa86 tempest-ProjectReaderTests-1000302715 None] Created volume successfully. Sep 16 17:57:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5b4632fe-e386-4d44-a79f-dd1fc735d33c tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da.0b72f9f7-6517-440d-bff8-90530d9ad85c" returned: 0 in 0.277s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5b4632fe-e386-4d44-a79f-dd1fc735d33c tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-0b72f9f7-6517-440d-bff8-90530d9ad85c" released by "_delete_snapshot" :: held 1.653s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5b4632fe-e386-4d44-a79f-dd1fc735d33c tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-5e14875c-8e42-4c06-a5a1-e7d7b94b44da" released by "delete_snapshot" :: held 1.684s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:44 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-5b4632fe-e386-4d44-a79f-dd1fc735d33c tempest-ProjectMemberTests-1735269541 None] Created reservations ['bfa9bcd4-04b0-4c13-a875-ca61e74c491d', 'b47c8d6d-8dc6-44c7-a259-d68f151b3c09', '7230b1c1-8d39-45ec-a1fc-11410b261af6', '0e87fe46-6898-4d63-873a-33aed5f05fda'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:44 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5b4632fe-e386-4d44-a79f-dd1fc735d33c tempest-ProjectMemberTests-1735269541 None] Delete snapshot completed successfully. Sep 16 17:57:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5b4632fe-e386-4d44-a79f-dd1fc735d33c tempest-ProjectMemberTests-1735269541 None] Lock "cinder-0b72f9f7-6517-440d-bff8-90530d9ad85c-delete_snapshot" released by "delete_snapshot" :: held 1.859s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b11bf053-adb8-47cc-b078-3dbbab056ca5 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-5e14875c-8e42-4c06-a5a1-e7d7b94b44da-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b11bf053-adb8-47cc-b078-3dbbab056ca5 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-5e14875c-8e42-4c06-a5a1-e7d7b94b44da-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b11bf053-adb8-47cc-b078-3dbbab056ca5 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-5e14875c-8e42-4c06-a5a1-e7d7b94b44da" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b11bf053-adb8-47cc-b078-3dbbab056ca5 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-5e14875c-8e42-4c06-a5a1-e7d7b94b44da" acquired by "delete_volume" :: waited 0.014s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:44 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6810ff59-0668-4bb1-a6a5-e5d9c68d673a]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b11bf053-adb8-47cc-b078-3dbbab056ca5 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:44 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da Sep 16 17:57:44 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:45 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b11bf053-adb8-47cc-b078-3dbbab056ca5 tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da" returned: 0 in 0.359s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b11bf053-adb8-47cc-b078-3dbbab056ca5 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:45 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da Sep 16 17:57:45 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bd999b74-909e-4e09-bb66-4ee141692e4e tempest-ProjectReaderTests-1000302715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bd999b74-909e-4e09-bb66-4ee141692e4e tempest-ProjectReaderTests-1000302715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:45 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b11bf053-adb8-47cc-b078-3dbbab056ca5 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-5e14875c-8e42-4c06-a5a1-e7d7b94b44da" returned: 0 in 0.470s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-bd999b74-909e-4e09-bb66-4ee141692e4e tempest-ProjectReaderTests-1000302715 None] Creating offline snapshot a4c691be-0fff-4873-9521-36a40f45cafb of volume 158fab0e-94d4-4e47-98c1-42a43a3b5df9 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:57:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b11bf053-adb8-47cc-b078-3dbbab056ca5 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-5e14875c-8e42-4c06-a5a1-e7d7b94b44da" released by "delete_volume" :: held 0.900s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:45 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef78d551-ea50-4021-9f6f-2e5f72288488]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bd999b74-909e-4e09-bb66-4ee141692e4e tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:45 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-b11bf053-adb8-47cc-b078-3dbbab056ca5 tempest-ProjectMemberTests-1735269541 None] Created reservations ['39803636-d41f-4e07-b588-6fc2ecdb6afa', '1a052faf-d91c-4e5b-9263-7394bbbb211e', '9c34a572-58a8-44f5-85f3-6e2038f9d5bb', '85875048-16b9-4bea-aff1-23933b81856f'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:45 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9 Sep 16 17:57:45 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b11bf053-adb8-47cc-b078-3dbbab056ca5 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b11bf053-adb8-47cc-b078-3dbbab056ca5 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b11bf053-adb8-47cc-b078-3dbbab056ca5 tempest-ProjectMemberTests-1735269541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b11bf053-adb8-47cc-b078-3dbbab056ca5 tempest-ProjectMemberTests-1735269541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b11bf053-adb8-47cc-b078-3dbbab056ca5 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b11bf053-adb8-47cc-b078-3dbbab056ca5 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:45 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:57:45 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:46 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bd999b74-909e-4e09-bb66-4ee141692e4e tempest-ProjectReaderTests-1000302715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9" returned: 0 in 0.452s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bd999b74-909e-4e09-bb66-4ee141692e4e tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.a4c691be-0fff-4873-9521-36a40f45cafb 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:46 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.a4c691be-0fff-4873-9521-36a40f45cafb 1G Sep 16 17:57:46 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:46 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b11bf053-adb8-47cc-b078-3dbbab056ca5 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.377s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:46 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b11bf053-adb8-47cc-b078-3dbbab056ca5 tempest-ProjectMemberTests-1735269541 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:57:46 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-b11bf053-adb8-47cc-b078-3dbbab056ca5 tempest-ProjectMemberTests-1735269541 None] Deleted volume successfully. Sep 16 17:57:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-b11bf053-adb8-47cc-b078-3dbbab056ca5 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-5e14875c-8e42-4c06-a5a1-e7d7b94b44da-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:46 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:57:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Flow 'volume_create_manager' (fba81ef6-9ade-4908-97f0-d593db7fc1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e9f4810-2ea2-4cc2-8275-2a4f0b15ebd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e9f4810-2ea2-4cc2-8275-2a4f0b15ebd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1364797622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41233a64-aeaa-4566-8e49-674899caae47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86c45c52eba4c698ff7edf1ea9c075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:57:47Z,use_quota=True,user_id='ff634f34ed8b49ceaa2f8e9b6bee7419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c742a365-b48f-45bf-a0cf-a16c108a61bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c742a365-b48f-45bf-a0cf-a16c108a61bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (979129fa-094b-458f-af88-95990a0765c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (979129fa-094b-458f-af88-95990a0765c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41233a64-aeaa-4566-8e49-674899caae47', 'volume_name': 'volume-41233a64-aeaa-4566-8e49-674899caae47', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8cdd21-4476-4452-8799-333f7b393b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8cdd21-4476-4452-8799-333f7b393b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3febc95-5aad-480d-a6de-1f176d20388b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:46 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Volume 41233a64-aeaa-4566-8e49-674899caae47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41233a64-aeaa-4566-8e49-674899caae47', 'volume_size': 1} Sep 16 17:57:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:46 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bd999b74-909e-4e09-bb66-4ee141692e4e tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.a4c691be-0fff-4873-9521-36a40f45cafb 1G" returned: 0 in 0.566s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bd999b74-909e-4e09-bb66-4ee141692e4e tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.a4c691be-0fff-4873-9521-36a40f45cafb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:46 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.a4c691be-0fff-4873-9521-36a40f45cafb Sep 16 17:57:46 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:47 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bd999b74-909e-4e09-bb66-4ee141692e4e tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.a4c691be-0fff-4873-9521-36a40f45cafb" returned: 0 in 0.283s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:47 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-bd999b74-909e-4e09-bb66-4ee141692e4e tempest-ProjectReaderTests-1000302715 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.a4c691be-0fff-4873-9521-36a40f45cafb is being set with open permissions: ugo+rw Sep 16 17:57:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bd999b74-909e-4e09-bb66-4ee141692e4e tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.a4c691be-0fff-4873-9521-36a40f45cafb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:47 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.a4c691be-0fff-4873-9521-36a40f45cafb Sep 16 17:57:47 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:47 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bd999b74-909e-4e09-bb66-4ee141692e4e tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.a4c691be-0fff-4873-9521-36a40f45cafb" returned: 0 in 0.236s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bd999b74-909e-4e09-bb66-4ee141692e4e tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:47 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.info Sep 16 17:57:47 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:47 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bd999b74-909e-4e09-bb66-4ee141692e4e tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.info" returned: 0 in 0.290s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:47 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-bd999b74-909e-4e09-bb66-4ee141692e4e tempest-ProjectReaderTests-1000302715 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.info is being set with open permissions: ugo+rw Sep 16 17:57:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bd999b74-909e-4e09-bb66-4ee141692e4e tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:47 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.info Sep 16 17:57:47 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:47 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bd999b74-909e-4e09-bb66-4ee141692e4e tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.info" returned: 0 in 0.261s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-bd999b74-909e-4e09-bb66-4ee141692e4e tempest-ProjectReaderTests-1000302715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.217s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.163s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1364797622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41233a64-aeaa-4566-8e49-674899caae47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86c45c52eba4c698ff7edf1ea9c075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:57:47Z,use_quota=True,user_id='ff634f34ed8b49ceaa2f8e9b6bee7419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:57:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Creating volume 41233a64-aeaa-4566-8e49-674899caae47 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:57:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:57:47 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:57:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:47 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47 1073741824 Sep 16 17:57:47 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:47 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-bd999b74-909e-4e09-bb66-4ee141692e4e tempest-ProjectReaderTests-1000302715 None] Create snapshot completed successfully Sep 16 17:57:48 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47 1073741824" returned: 0 in 0.476s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:48 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47 Sep 16 17:57:48 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:48 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47" returned: 0 in 0.255s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:57:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3febc95-5aad-480d-a6de-1f176d20388b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41233a64-aeaa-4566-8e49-674899caae47', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (216d1701-5742-4232-a898-f383a7f1bc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:48 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Volume volume-41233a64-aeaa-4566-8e49-674899caae47 (41233a64-aeaa-4566-8e49-674899caae47): created successfully Sep 16 17:57:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (216d1701-5742-4232-a898-f383a7f1bc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:48 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Flow 'volume_create_manager' (fba81ef6-9ade-4908-97f0-d593db7fc1ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:48 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-a7148b48-30b8-48fa-844e-a68286ac638c tempest-ProjectMemberTests-1735269541 None] Created volume successfully. Sep 16 17:57:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-88267d90-b89c-4eac-a653-ebd155d72178 tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-a4c691be-0fff-4873-9521-36a40f45cafb-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-88267d90-b89c-4eac-a653-ebd155d72178 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-a4c691be-0fff-4873-9521-36a40f45cafb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-88267d90-b89c-4eac-a653-ebd155d72178 tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-quobyte-158fab0e-94d4-4e47-98c1-42a43a3b5df9" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-88267d90-b89c-4eac-a653-ebd155d72178 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-158fab0e-94d4-4e47-98c1-42a43a3b5df9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-88267d90-b89c-4eac-a653-ebd155d72178 tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-quobyte-a4c691be-0fff-4873-9521-36a40f45cafb" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-88267d90-b89c-4eac-a653-ebd155d72178 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-a4c691be-0fff-4873-9521-36a40f45cafb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-88267d90-b89c-4eac-a653-ebd155d72178 tempest-ProjectReaderTests-1000302715 None] Deleting offline snapshot a4c691be-0fff-4873-9521-36a40f45cafb of volume 158fab0e-94d4-4e47-98c1-42a43a3b5df9 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:57:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-88267d90-b89c-4eac-a653-ebd155d72178 tempest-ProjectReaderTests-1000302715 None] snapshot_file for this snap is: volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.a4c691be-0fff-4873-9521-36a40f45cafb {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:57:48 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec0b838-f4fd-4de8-8b4d-b7f799dfcb7a]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-88267d90-b89c-4eac-a653-ebd155d72178 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.a4c691be-0fff-4873-9521-36a40f45cafb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:49 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.a4c691be-0fff-4873-9521-36a40f45cafb Sep 16 17:57:49 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:49 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-88267d90-b89c-4eac-a653-ebd155d72178 tempest-ProjectReaderTests-1000302715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.a4c691be-0fff-4873-9521-36a40f45cafb" returned: 0 in 0.376s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-88267d90-b89c-4eac-a653-ebd155d72178 tempest-ProjectReaderTests-1000302715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:57:49 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54d6500-9f8a-459c-8f38-218b5f58d149]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-88267d90-b89c-4eac-a653-ebd155d72178 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:49 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9 Sep 16 17:57:49 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:49 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-88267d90-b89c-4eac-a653-ebd155d72178 tempest-ProjectReaderTests-1000302715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9" returned: 0 in 0.387s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-88267d90-b89c-4eac-a653-ebd155d72178 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.a4c691be-0fff-4873-9521-36a40f45cafb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:49 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.a4c691be-0fff-4873-9521-36a40f45cafb Sep 16 17:57:49 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0c9013f2-3b30-4ee0-b408-54d1d1e10442 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0c9013f2-3b30-4ee0-b408-54d1d1e10442 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-0c9013f2-3b30-4ee0-b408-54d1d1e10442 tempest-ProjectMemberTests-1735269541 None] Creating offline snapshot 02eda143-a47d-436c-b71e-871409ddfe18 of volume 41233a64-aeaa-4566-8e49-674899caae47 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:57:49 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f31d5b3-d1a9-426c-b75c-7a09f0a286d3]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0c9013f2-3b30-4ee0-b408-54d1d1e10442 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:50 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47 Sep 16 17:57:50 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:50 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-88267d90-b89c-4eac-a653-ebd155d72178 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.a4c691be-0fff-4873-9521-36a40f45cafb" returned: 0 in 0.398s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-88267d90-b89c-4eac-a653-ebd155d72178 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.a4c691be-0fff-4873-9521-36a40f45cafb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:50 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.a4c691be-0fff-4873-9521-36a40f45cafb Sep 16 17:57:50 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:50 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0c9013f2-3b30-4ee0-b408-54d1d1e10442 tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47" returned: 0 in 0.466s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0c9013f2-3b30-4ee0-b408-54d1d1e10442 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.02eda143-a47d-436c-b71e-871409ddfe18 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:50 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.02eda143-a47d-436c-b71e-871409ddfe18 1G Sep 16 17:57:50 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:50 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-88267d90-b89c-4eac-a653-ebd155d72178 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9.a4c691be-0fff-4873-9521-36a40f45cafb" returned: 0 in 0.339s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-88267d90-b89c-4eac-a653-ebd155d72178 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-a4c691be-0fff-4873-9521-36a40f45cafb" released by "_delete_snapshot" :: held 1.633s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-88267d90-b89c-4eac-a653-ebd155d72178 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-158fab0e-94d4-4e47-98c1-42a43a3b5df9" released by "delete_snapshot" :: held 1.660s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:50 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-88267d90-b89c-4eac-a653-ebd155d72178 tempest-ProjectReaderTests-1000302715 None] Created reservations ['73a43bdf-5ecf-45aa-99ca-2735933d3449', 'b8b4db32-1436-41c4-93f7-b300b75c57d0', '2f939796-396d-4925-a786-0151c176891a', 'fc33a7e2-ff62-4cc9-8502-02dec73a83f3'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:50 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-88267d90-b89c-4eac-a653-ebd155d72178 tempest-ProjectReaderTests-1000302715 None] Delete snapshot completed successfully. Sep 16 17:57:50 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-88267d90-b89c-4eac-a653-ebd155d72178 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-a4c691be-0fff-4873-9521-36a40f45cafb-delete_snapshot" released by "delete_snapshot" :: held 1.834s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:50 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0c9013f2-3b30-4ee0-b408-54d1d1e10442 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.02eda143-a47d-436c-b71e-871409ddfe18 1G" returned: 0 in 0.486s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0c9013f2-3b30-4ee0-b408-54d1d1e10442 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41233a64-aeaa-4566-8e49-674899caae47 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.02eda143-a47d-436c-b71e-871409ddfe18 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:50 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41233a64-aeaa-4566-8e49-674899caae47 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.02eda143-a47d-436c-b71e-871409ddfe18 Sep 16 17:57:50 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-06fc3a42-17e8-487f-9af5-7e0ee76e90d8 tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-158fab0e-94d4-4e47-98c1-42a43a3b5df9-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-06fc3a42-17e8-487f-9af5-7e0ee76e90d8 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-158fab0e-94d4-4e47-98c1-42a43a3b5df9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-06fc3a42-17e8-487f-9af5-7e0ee76e90d8 tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-quobyte-158fab0e-94d4-4e47-98c1-42a43a3b5df9" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-06fc3a42-17e8-487f-9af5-7e0ee76e90d8 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-158fab0e-94d4-4e47-98c1-42a43a3b5df9" acquired by "delete_volume" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:51 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a72f2b-62d1-4251-8b89-f9997a290323]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-06fc3a42-17e8-487f-9af5-7e0ee76e90d8 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:51 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0c9013f2-3b30-4ee0-b408-54d1d1e10442 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41233a64-aeaa-4566-8e49-674899caae47 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.02eda143-a47d-436c-b71e-871409ddfe18" returned: 0 in 0.382s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:51 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-0c9013f2-3b30-4ee0-b408-54d1d1e10442 tempest-ProjectMemberTests-1735269541 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.02eda143-a47d-436c-b71e-871409ddfe18 is being set with open permissions: ugo+rw Sep 16 17:57:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0c9013f2-3b30-4ee0-b408-54d1d1e10442 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.02eda143-a47d-436c-b71e-871409ddfe18 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:51 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.02eda143-a47d-436c-b71e-871409ddfe18 Sep 16 17:57:51 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:51 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9 Sep 16 17:57:51 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:51 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0c9013f2-3b30-4ee0-b408-54d1d1e10442 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.02eda143-a47d-436c-b71e-871409ddfe18" returned: 0 in 0.279s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0c9013f2-3b30-4ee0-b408-54d1d1e10442 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:51 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.info Sep 16 17:57:51 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:51 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-06fc3a42-17e8-487f-9af5-7e0ee76e90d8 tempest-ProjectReaderTests-1000302715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9" returned: 0 in 0.466s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-06fc3a42-17e8-487f-9af5-7e0ee76e90d8 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:51 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9 Sep 16 17:57:51 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:51 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0c9013f2-3b30-4ee0-b408-54d1d1e10442 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.info" returned: 0 in 0.291s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:51 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-0c9013f2-3b30-4ee0-b408-54d1d1e10442 tempest-ProjectMemberTests-1735269541 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.info is being set with open permissions: ugo+rw Sep 16 17:57:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0c9013f2-3b30-4ee0-b408-54d1d1e10442 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:51 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.info Sep 16 17:57:51 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:51 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-06fc3a42-17e8-487f-9af5-7e0ee76e90d8 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-158fab0e-94d4-4e47-98c1-42a43a3b5df9" returned: 0 in 0.274s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-06fc3a42-17e8-487f-9af5-7e0ee76e90d8 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-158fab0e-94d4-4e47-98c1-42a43a3b5df9" released by "delete_volume" :: held 0.811s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-06fc3a42-17e8-487f-9af5-7e0ee76e90d8 tempest-ProjectReaderTests-1000302715 None] Created reservations ['8b6833b9-12e0-4601-b922-8bff56804208', '5c2a1641-25de-4400-8af4-0c1f2506be43', '13a12858-8f17-48ec-95e3-cf98aa272b86', 'cc3a9220-b4b8-4d4a-bdd0-1a3315950e98'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-06fc3a42-17e8-487f-9af5-7e0ee76e90d8 tempest-ProjectReaderTests-1000302715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-06fc3a42-17e8-487f-9af5-7e0ee76e90d8 tempest-ProjectReaderTests-1000302715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-06fc3a42-17e8-487f-9af5-7e0ee76e90d8 tempest-ProjectReaderTests-1000302715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-06fc3a42-17e8-487f-9af5-7e0ee76e90d8 tempest-ProjectReaderTests-1000302715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-06fc3a42-17e8-487f-9af5-7e0ee76e90d8 tempest-ProjectReaderTests-1000302715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-06fc3a42-17e8-487f-9af5-7e0ee76e90d8 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:52 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-0c9013f2-3b30-4ee0-b408-54d1d1e10442 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.info" returned: 0 in 0.299s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:52 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:57:52 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-0c9013f2-3b30-4ee0-b408-54d1d1e10442 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.318s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:52 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-0c9013f2-3b30-4ee0-b408-54d1d1e10442 tempest-ProjectMemberTests-1735269541 None] Create snapshot completed successfully Sep 16 17:57:52 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-06fc3a42-17e8-487f-9af5-7e0ee76e90d8 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.296s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-06fc3a42-17e8-487f-9af5-7e0ee76e90d8 tempest-ProjectReaderTests-1000302715 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:57:52 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-06fc3a42-17e8-487f-9af5-7e0ee76e90d8 tempest-ProjectReaderTests-1000302715 None] Deleted volume successfully. Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-06fc3a42-17e8-487f-9af5-7e0ee76e90d8 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-158fab0e-94d4-4e47-98c1-42a43a3b5df9-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Flow 'volume_create_manager' (f01e33f9-6380-4e99-9fb2-b6d52ec16348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0319ce5-d562-4dd5-a249-27984428ca83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0319ce5-d562-4dd5-a249-27984428ca83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1962421315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9471b7bb-a8a7-44ac-8c13-9243019d76d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4b789bddcb41348d6a1edb0b27ddda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:57:53Z,use_quota=True,user_id='90797b4d598d4280a4e5f75e51387205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33015a25-020d-4a14-96de-6aea68931c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33015a25-020d-4a14-96de-6aea68931c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3d15ef-96a6-43ee-8010-75ac0e4c184c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3d15ef-96a6-43ee-8010-75ac0e4c184c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9471b7bb-a8a7-44ac-8c13-9243019d76d9', 'volume_name': 'volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e26da65-5265-440b-985c-4ff2ac4fdf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e26da65-5265-440b-985c-4ff2ac4fdf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be66fc7-17aa-4f3d-8cca-027ea8ab7b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:52 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Volume 9471b7bb-a8a7-44ac-8c13-9243019d76d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9', 'volume_size': 1} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1962421315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9471b7bb-a8a7-44ac-8c13-9243019d76d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4b789bddcb41348d6a1edb0b27ddda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:57:53Z,use_quota=True,user_id='90797b4d598d4280a4e5f75e51387205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Creating volume 9471b7bb-a8a7-44ac-8c13-9243019d76d9 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:57:52 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:57:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:52 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9 1073741824 Sep 16 17:57:52 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5e183688-7feb-40ad-b146-1ec668a6ff5a tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-02eda143-a47d-436c-b71e-871409ddfe18-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5e183688-7feb-40ad-b146-1ec668a6ff5a tempest-ProjectMemberTests-1735269541 None] Lock "cinder-02eda143-a47d-436c-b71e-871409ddfe18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5e183688-7feb-40ad-b146-1ec668a6ff5a tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-41233a64-aeaa-4566-8e49-674899caae47" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5e183688-7feb-40ad-b146-1ec668a6ff5a tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-41233a64-aeaa-4566-8e49-674899caae47" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5e183688-7feb-40ad-b146-1ec668a6ff5a tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-02eda143-a47d-436c-b71e-871409ddfe18" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5e183688-7feb-40ad-b146-1ec668a6ff5a tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-02eda143-a47d-436c-b71e-871409ddfe18" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5e183688-7feb-40ad-b146-1ec668a6ff5a tempest-ProjectMemberTests-1735269541 None] Deleting offline snapshot 02eda143-a47d-436c-b71e-871409ddfe18 of volume 41233a64-aeaa-4566-8e49-674899caae47 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5e183688-7feb-40ad-b146-1ec668a6ff5a tempest-ProjectMemberTests-1735269541 None] snapshot_file for this snap is: volume-41233a64-aeaa-4566-8e49-674899caae47.02eda143-a47d-436c-b71e-871409ddfe18 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae624972-2847-4dc3-a01d-c7eb384c7e49]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e183688-7feb-40ad-b146-1ec668a6ff5a tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.02eda143-a47d-436c-b71e-871409ddfe18 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:53 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.02eda143-a47d-436c-b71e-871409ddfe18 Sep 16 17:57:53 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:53 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9 1073741824" returned: 0 in 0.472s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:53 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9 Sep 16 17:57:53 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:53 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e183688-7feb-40ad-b146-1ec668a6ff5a tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.02eda143-a47d-436c-b71e-871409ddfe18" returned: 0 in 0.374s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5e183688-7feb-40ad-b146-1ec668a6ff5a tempest-ProjectMemberTests-1735269541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41233a64-aeaa-4566-8e49-674899caae47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76e8ad9-f689-437f-a02a-724c57e126c3]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e183688-7feb-40ad-b146-1ec668a6ff5a tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:53 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9" returned: 0 in 0.248s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be66fc7-17aa-4f3d-8cca-027ea8ab7b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b4773c-ca88-41ac-8e7f-9bc52891d626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:53 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Volume volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9 (9471b7bb-a8a7-44ac-8c13-9243019d76d9): created successfully Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b4773c-ca88-41ac-8e7f-9bc52891d626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Flow 'volume_create_manager' (f01e33f9-6380-4e99-9fb2-b6d52ec16348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:53 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-ed411189-91d5-47ea-bb43-19e0ddd6ccd3 tempest-ProjectReaderTests-1000302715 None] Created volume successfully. Sep 16 17:57:53 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47 Sep 16 17:57:53 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a20d6672-be9d-4af2-b53d-645d0160a0f7 tempest-ProjectReaderTests-1000302715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a20d6672-be9d-4af2-b53d-645d0160a0f7 tempest-ProjectReaderTests-1000302715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-a20d6672-be9d-4af2-b53d-645d0160a0f7 tempest-ProjectReaderTests-1000302715 None] Creating offline snapshot 1c657a31-a063-4b10-824f-a25a332257e5 of volume 9471b7bb-a8a7-44ac-8c13-9243019d76d9 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d77e2f7-7ec1-4ff1-8737-578a9e59d1bb]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a20d6672-be9d-4af2-b53d-645d0160a0f7 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:53 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e183688-7feb-40ad-b146-1ec668a6ff5a tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47" returned: 0 in 0.389s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:53 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e183688-7feb-40ad-b146-1ec668a6ff5a tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.02eda143-a47d-436c-b71e-871409ddfe18 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:53 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.02eda143-a47d-436c-b71e-871409ddfe18 Sep 16 17:57:53 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:54 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9 Sep 16 17:57:54 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:54 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e183688-7feb-40ad-b146-1ec668a6ff5a tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.02eda143-a47d-436c-b71e-871409ddfe18" returned: 0 in 0.338s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e183688-7feb-40ad-b146-1ec668a6ff5a tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.02eda143-a47d-436c-b71e-871409ddfe18 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:54 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a20d6672-be9d-4af2-b53d-645d0160a0f7 tempest-ProjectReaderTests-1000302715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9" returned: 0 in 0.372s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a20d6672-be9d-4af2-b53d-645d0160a0f7 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.1c657a31-a063-4b10-824f-a25a332257e5 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:54 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.02eda143-a47d-436c-b71e-871409ddfe18 Sep 16 17:57:54 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:54 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.1c657a31-a063-4b10-824f-a25a332257e5 1G Sep 16 17:57:54 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:54 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e183688-7feb-40ad-b146-1ec668a6ff5a tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47.02eda143-a47d-436c-b71e-871409ddfe18" returned: 0 in 0.270s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:54 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5e183688-7feb-40ad-b146-1ec668a6ff5a tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-02eda143-a47d-436c-b71e-871409ddfe18" released by "_delete_snapshot" :: held 1.483s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:54 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5e183688-7feb-40ad-b146-1ec668a6ff5a tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-41233a64-aeaa-4566-8e49-674899caae47" released by "delete_snapshot" :: held 1.513s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:54 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-5e183688-7feb-40ad-b146-1ec668a6ff5a tempest-ProjectMemberTests-1735269541 None] Created reservations ['ec071c02-b1ff-4634-87d8-8557838560f0', '43060b2c-6dc1-4113-b615-f2e956a15ee7', '7b7baf75-a558-4208-a8c7-b831b637214c', '3de4431f-c5dd-4b2e-bc02-4f48d7dc3d51'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:54 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5e183688-7feb-40ad-b146-1ec668a6ff5a tempest-ProjectMemberTests-1735269541 None] Delete snapshot completed successfully. Sep 16 17:57:54 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5e183688-7feb-40ad-b146-1ec668a6ff5a tempest-ProjectMemberTests-1735269541 None] Lock "cinder-02eda143-a47d-436c-b71e-871409ddfe18-delete_snapshot" released by "delete_snapshot" :: held 1.662s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:54 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a20d6672-be9d-4af2-b53d-645d0160a0f7 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.1c657a31-a063-4b10-824f-a25a332257e5 1G" returned: 0 in 0.455s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:54 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a20d6672-be9d-4af2-b53d-645d0160a0f7 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.1c657a31-a063-4b10-824f-a25a332257e5 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:54 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.1c657a31-a063-4b10-824f-a25a332257e5 Sep 16 17:57:54 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:55 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a20d6672-be9d-4af2-b53d-645d0160a0f7 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.1c657a31-a063-4b10-824f-a25a332257e5" returned: 0 in 0.284s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:55 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-a20d6672-be9d-4af2-b53d-645d0160a0f7 tempest-ProjectReaderTests-1000302715 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.1c657a31-a063-4b10-824f-a25a332257e5 is being set with open permissions: ugo+rw Sep 16 17:57:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a20d6672-be9d-4af2-b53d-645d0160a0f7 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.1c657a31-a063-4b10-824f-a25a332257e5 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:55 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.1c657a31-a063-4b10-824f-a25a332257e5 Sep 16 17:57:55 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:55 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-caba37c2-bcd9-4bdc-9b4d-7710d0ea2229 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-41233a64-aeaa-4566-8e49-674899caae47-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:55 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-caba37c2-bcd9-4bdc-9b4d-7710d0ea2229 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-41233a64-aeaa-4566-8e49-674899caae47-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:55 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-caba37c2-bcd9-4bdc-9b4d-7710d0ea2229 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-41233a64-aeaa-4566-8e49-674899caae47" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:55 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-caba37c2-bcd9-4bdc-9b4d-7710d0ea2229 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-41233a64-aeaa-4566-8e49-674899caae47" acquired by "delete_volume" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:55 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a20d6672-be9d-4af2-b53d-645d0160a0f7 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.1c657a31-a063-4b10-824f-a25a332257e5" returned: 0 in 0.274s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:55 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6076628a-a2b9-425f-9ca6-7e812d045c10]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-caba37c2-bcd9-4bdc-9b4d-7710d0ea2229 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a20d6672-be9d-4af2-b53d-645d0160a0f7 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:55 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.info Sep 16 17:57:55 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:55 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47 Sep 16 17:57:55 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:55 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a20d6672-be9d-4af2-b53d-645d0160a0f7 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.info" returned: 0 in 0.265s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:55 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-a20d6672-be9d-4af2-b53d-645d0160a0f7 tempest-ProjectReaderTests-1000302715 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.info is being set with open permissions: ugo+rw Sep 16 17:57:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a20d6672-be9d-4af2-b53d-645d0160a0f7 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:55 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.info Sep 16 17:57:55 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:55 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-caba37c2-bcd9-4bdc-9b4d-7710d0ea2229 tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47" returned: 0 in 0.399s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-caba37c2-bcd9-4bdc-9b4d-7710d0ea2229 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:55 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47 Sep 16 17:57:55 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:55 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a20d6672-be9d-4af2-b53d-645d0160a0f7 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.info" returned: 0 in 0.255s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a20d6672-be9d-4af2-b53d-645d0160a0f7 tempest-ProjectReaderTests-1000302715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:55 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-a20d6672-be9d-4af2-b53d-645d0160a0f7 tempest-ProjectReaderTests-1000302715 None] Create snapshot completed successfully Sep 16 17:57:55 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:55 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-caba37c2-bcd9-4bdc-9b4d-7710d0ea2229 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-41233a64-aeaa-4566-8e49-674899caae47" returned: 0 in 0.268s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:55 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-caba37c2-bcd9-4bdc-9b4d-7710d0ea2229 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-41233a64-aeaa-4566-8e49-674899caae47" released by "delete_volume" :: held 0.728s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-caba37c2-bcd9-4bdc-9b4d-7710d0ea2229 tempest-ProjectMemberTests-1735269541 None] Created reservations ['f95ee0ab-3e07-4be0-bee6-b6ef7d816fa3', '431fe0b9-d854-4414-9f43-b5bb337b6ea7', '51aa4e32-cac3-492a-8c29-6b6f6c17261f', '1f1d7465-8ed5-40f3-9bf8-51ba12669dec'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-caba37c2-bcd9-4bdc-9b4d-7710d0ea2229 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-caba37c2-bcd9-4bdc-9b4d-7710d0ea2229 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-caba37c2-bcd9-4bdc-9b4d-7710d0ea2229 tempest-ProjectMemberTests-1735269541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-caba37c2-bcd9-4bdc-9b4d-7710d0ea2229 tempest-ProjectMemberTests-1735269541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-caba37c2-bcd9-4bdc-9b4d-7710d0ea2229 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-caba37c2-bcd9-4bdc-9b4d-7710d0ea2229 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:56 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:57:56 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:56 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-caba37c2-bcd9-4bdc-9b4d-7710d0ea2229 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.276s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-caba37c2-bcd9-4bdc-9b4d-7710d0ea2229 tempest-ProjectMemberTests-1735269541 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:57:56 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-caba37c2-bcd9-4bdc-9b4d-7710d0ea2229 tempest-ProjectMemberTests-1735269541 None] Deleted volume successfully. Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-caba37c2-bcd9-4bdc-9b4d-7710d0ea2229 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-41233a64-aeaa-4566-8e49-674899caae47-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Flow 'volume_create_manager' (8b80a88c-90b7-404b-88f2-bd7ef65b050b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da4108f-66be-4dd7-b7b8-0ce0d5d64aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da4108f-66be-4dd7-b7b8-0ce0d5d64aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-288919244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7578ef72-fe39-47c5-9eab-cdc9ff4122f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86c45c52eba4c698ff7edf1ea9c075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:57:57Z,use_quota=True,user_id='ff634f34ed8b49ceaa2f8e9b6bee7419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893c54e3-9dd5-49ff-be1e-1ce8bdfad0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893c54e3-9dd5-49ff-be1e-1ce8bdfad0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb01e31-934e-47e4-a383-2fa1bb46bee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb01e31-934e-47e4-a383-2fa1bb46bee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7578ef72-fe39-47c5-9eab-cdc9ff4122f0', 'volume_name': 'volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c0e2a5-d7b1-43a4-a99c-5d6e8689be8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c0e2a5-d7b1-43a4-a99c-5d6e8689be8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87400930-f3a2-4e1d-bf3b-c350f18bb30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:56 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Volume 7578ef72-fe39-47c5-9eab-cdc9ff4122f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0', 'volume_size': 1} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-288919244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7578ef72-fe39-47c5-9eab-cdc9ff4122f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86c45c52eba4c698ff7edf1ea9c075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:57:57Z,use_quota=True,user_id='ff634f34ed8b49ceaa2f8e9b6bee7419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Creating volume 7578ef72-fe39-47c5-9eab-cdc9ff4122f0 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:57:56 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:57:56 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:56 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0 1073741824 Sep 16 17:57:56 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-99c0193a-8032-460e-863d-bb98d79a0a6e tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-1c657a31-a063-4b10-824f-a25a332257e5-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-99c0193a-8032-460e-863d-bb98d79a0a6e tempest-ProjectReaderTests-1000302715 None] Lock "cinder-1c657a31-a063-4b10-824f-a25a332257e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-99c0193a-8032-460e-863d-bb98d79a0a6e tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-quobyte-9471b7bb-a8a7-44ac-8c13-9243019d76d9" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-99c0193a-8032-460e-863d-bb98d79a0a6e tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-9471b7bb-a8a7-44ac-8c13-9243019d76d9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-99c0193a-8032-460e-863d-bb98d79a0a6e tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-quobyte-1c657a31-a063-4b10-824f-a25a332257e5" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-99c0193a-8032-460e-863d-bb98d79a0a6e tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-1c657a31-a063-4b10-824f-a25a332257e5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-99c0193a-8032-460e-863d-bb98d79a0a6e tempest-ProjectReaderTests-1000302715 None] Deleting offline snapshot 1c657a31-a063-4b10-824f-a25a332257e5 of volume 9471b7bb-a8a7-44ac-8c13-9243019d76d9 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-99c0193a-8032-460e-863d-bb98d79a0a6e tempest-ProjectReaderTests-1000302715 None] snapshot_file for this snap is: volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.1c657a31-a063-4b10-824f-a25a332257e5 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6a43bb-6778-47a1-acf0-ba60b0e75603]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-99c0193a-8032-460e-863d-bb98d79a0a6e tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.1c657a31-a063-4b10-824f-a25a332257e5 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:57 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.1c657a31-a063-4b10-824f-a25a332257e5 Sep 16 17:57:57 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:57 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0 1073741824" returned: 0 in 0.432s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:57 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0 Sep 16 17:57:57 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:57 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-99c0193a-8032-460e-863d-bb98d79a0a6e tempest-ProjectReaderTests-1000302715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.1c657a31-a063-4b10-824f-a25a332257e5" returned: 0 in 0.368s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-99c0193a-8032-460e-863d-bb98d79a0a6e tempest-ProjectReaderTests-1000302715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7681efd8-325a-47a3-9cba-7150c6fdf268]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-99c0193a-8032-460e-863d-bb98d79a0a6e tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:57 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0" returned: 0 in 0.264s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87400930-f3a2-4e1d-bf3b-c350f18bb30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6046d167-3f78-4fe6-aeb6-9b41f5b9b337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:57:57 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Volume volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0 (7578ef72-fe39-47c5-9eab-cdc9ff4122f0): created successfully Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6046d167-3f78-4fe6-aeb6-9b41f5b9b337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:57:57 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9 Sep 16 17:57:57 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Flow 'volume_create_manager' (8b80a88c-90b7-404b-88f2-bd7ef65b050b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:57:57 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-a188644c-c712-4fee-816a-3507a0ceb007 tempest-ProjectMemberTests-1735269541 None] Created volume successfully. Sep 16 17:57:57 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-99c0193a-8032-460e-863d-bb98d79a0a6e tempest-ProjectReaderTests-1000302715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9" returned: 0 in 0.388s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-99c0193a-8032-460e-863d-bb98d79a0a6e tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.1c657a31-a063-4b10-824f-a25a332257e5 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:57 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.1c657a31-a063-4b10-824f-a25a332257e5 Sep 16 17:57:57 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-97eed4de-4f30-4fe3-8e77-1b9bfb6786aa tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-97eed4de-4f30-4fe3-8e77-1b9bfb6786aa tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-97eed4de-4f30-4fe3-8e77-1b9bfb6786aa tempest-ProjectMemberTests-1735269541 None] Creating offline snapshot d72bc655-b5bb-4d8f-8b52-bd925e9aa781 of volume 7578ef72-fe39-47c5-9eab-cdc9ff4122f0 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4183dad9-fcdb-4e22-b53e-d4d9444b0ce0]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:57 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-97eed4de-4f30-4fe3-8e77-1b9bfb6786aa tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:58 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0 Sep 16 17:57:58 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:58 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-99c0193a-8032-460e-863d-bb98d79a0a6e tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.1c657a31-a063-4b10-824f-a25a332257e5" returned: 0 in 0.342s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-99c0193a-8032-460e-863d-bb98d79a0a6e tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.1c657a31-a063-4b10-824f-a25a332257e5 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:58 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.1c657a31-a063-4b10-824f-a25a332257e5 Sep 16 17:57:58 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:58 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-97eed4de-4f30-4fe3-8e77-1b9bfb6786aa tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0" returned: 0 in 0.367s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-97eed4de-4f30-4fe3-8e77-1b9bfb6786aa tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.d72bc655-b5bb-4d8f-8b52-bd925e9aa781 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:58 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.d72bc655-b5bb-4d8f-8b52-bd925e9aa781 1G Sep 16 17:57:58 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:58 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-99c0193a-8032-460e-863d-bb98d79a0a6e tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9.1c657a31-a063-4b10-824f-a25a332257e5" returned: 0 in 0.257s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-99c0193a-8032-460e-863d-bb98d79a0a6e tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-1c657a31-a063-4b10-824f-a25a332257e5" released by "_delete_snapshot" :: held 1.453s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-99c0193a-8032-460e-863d-bb98d79a0a6e tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-9471b7bb-a8a7-44ac-8c13-9243019d76d9" released by "delete_snapshot" :: held 1.481s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:58 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-99c0193a-8032-460e-863d-bb98d79a0a6e tempest-ProjectReaderTests-1000302715 None] Created reservations ['74c54f99-982a-4454-be2c-fe52fd030907', 'a65c4a4c-9d5f-44f7-b246-438575d3b3d0', '4102a559-b3ce-4ba7-bdfc-d32864644cf2', '1710bf43-949b-4a77-bf89-3995970ea802'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:57:58 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-99c0193a-8032-460e-863d-bb98d79a0a6e tempest-ProjectReaderTests-1000302715 None] Delete snapshot completed successfully. Sep 16 17:57:58 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-99c0193a-8032-460e-863d-bb98d79a0a6e tempest-ProjectReaderTests-1000302715 None] Lock "cinder-1c657a31-a063-4b10-824f-a25a332257e5-delete_snapshot" released by "delete_snapshot" :: held 1.627s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:57:58 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-97eed4de-4f30-4fe3-8e77-1b9bfb6786aa tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.d72bc655-b5bb-4d8f-8b52-bd925e9aa781 1G" returned: 0 in 0.409s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:58 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-97eed4de-4f30-4fe3-8e77-1b9bfb6786aa tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.d72bc655-b5bb-4d8f-8b52-bd925e9aa781 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:58 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.d72bc655-b5bb-4d8f-8b52-bd925e9aa781 Sep 16 17:57:58 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:59 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-97eed4de-4f30-4fe3-8e77-1b9bfb6786aa tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.d72bc655-b5bb-4d8f-8b52-bd925e9aa781" returned: 0 in 0.282s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:59 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-97eed4de-4f30-4fe3-8e77-1b9bfb6786aa tempest-ProjectMemberTests-1735269541 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.d72bc655-b5bb-4d8f-8b52-bd925e9aa781 is being set with open permissions: ugo+rw Sep 16 17:57:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-97eed4de-4f30-4fe3-8e77-1b9bfb6786aa tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.d72bc655-b5bb-4d8f-8b52-bd925e9aa781 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:59 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.d72bc655-b5bb-4d8f-8b52-bd925e9aa781 Sep 16 17:57:59 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-80c54a4b-cd06-4790-8b13-e7fd635b1b0d tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-9471b7bb-a8a7-44ac-8c13-9243019d76d9-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-80c54a4b-cd06-4790-8b13-e7fd635b1b0d tempest-ProjectReaderTests-1000302715 None] Lock "cinder-9471b7bb-a8a7-44ac-8c13-9243019d76d9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-80c54a4b-cd06-4790-8b13-e7fd635b1b0d tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-quobyte-9471b7bb-a8a7-44ac-8c13-9243019d76d9" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:57:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-80c54a4b-cd06-4790-8b13-e7fd635b1b0d tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-9471b7bb-a8a7-44ac-8c13-9243019d76d9" acquired by "delete_volume" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:57:59 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-97eed4de-4f30-4fe3-8e77-1b9bfb6786aa tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.d72bc655-b5bb-4d8f-8b52-bd925e9aa781" returned: 0 in 0.267s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:59 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[452135f4-4d3c-4f83-9e13-a459ff2538d8]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:57:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80c54a4b-cd06-4790-8b13-e7fd635b1b0d tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-97eed4de-4f30-4fe3-8e77-1b9bfb6786aa tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:59 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.info Sep 16 17:57:59 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:59 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9 Sep 16 17:57:59 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:59 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-97eed4de-4f30-4fe3-8e77-1b9bfb6786aa tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.info" returned: 0 in 0.266s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:59 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-97eed4de-4f30-4fe3-8e77-1b9bfb6786aa tempest-ProjectMemberTests-1735269541 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.info is being set with open permissions: ugo+rw Sep 16 17:57:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-97eed4de-4f30-4fe3-8e77-1b9bfb6786aa tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:59 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.info Sep 16 17:57:59 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:59 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80c54a4b-cd06-4790-8b13-e7fd635b1b0d tempest-ProjectReaderTests-1000302715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9" returned: 0 in 0.382s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80c54a4b-cd06-4790-8b13-e7fd635b1b0d tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:57:59 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9 Sep 16 17:57:59 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:57:59 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-97eed4de-4f30-4fe3-8e77-1b9bfb6786aa tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.info" returned: 0 in 0.245s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-97eed4de-4f30-4fe3-8e77-1b9bfb6786aa tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.936s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:57:59 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-97eed4de-4f30-4fe3-8e77-1b9bfb6786aa tempest-ProjectMemberTests-1735269541 None] Create snapshot completed successfully Sep 16 17:57:59 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 16 17:57:59 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80c54a4b-cd06-4790-8b13-e7fd635b1b0d tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-9471b7bb-a8a7-44ac-8c13-9243019d76d9" returned: 0 in 0.257s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:57:59 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-80c54a4b-cd06-4790-8b13-e7fd635b1b0d tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-9471b7bb-a8a7-44ac-8c13-9243019d76d9" released by "delete_volume" :: held 0.704s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-80c54a4b-cd06-4790-8b13-e7fd635b1b0d tempest-ProjectReaderTests-1000302715 None] Created reservations ['4c0bfbda-cd68-430d-ac3c-f84530333b84', '1b86d0a7-739b-4281-8ac3-8099046746e1', '3e53a346-74a9-467f-9e2a-6294ad632834', '673beda7-a41c-4017-86e2-e56a83560401'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fe256af0-dda6-4311-87a4-fc460e79ccac tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-d72bc655-b5bb-4d8f-8b52-bd925e9aa781-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-80c54a4b-cd06-4790-8b13-e7fd635b1b0d tempest-ProjectReaderTests-1000302715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-80c54a4b-cd06-4790-8b13-e7fd635b1b0d tempest-ProjectReaderTests-1000302715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-80c54a4b-cd06-4790-8b13-e7fd635b1b0d tempest-ProjectReaderTests-1000302715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-80c54a4b-cd06-4790-8b13-e7fd635b1b0d tempest-ProjectReaderTests-1000302715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-80c54a4b-cd06-4790-8b13-e7fd635b1b0d tempest-ProjectReaderTests-1000302715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80c54a4b-cd06-4790-8b13-e7fd635b1b0d tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fe256af0-dda6-4311-87a4-fc460e79ccac tempest-ProjectMemberTests-1735269541 None] Lock "cinder-d72bc655-b5bb-4d8f-8b52-bd925e9aa781-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fe256af0-dda6-4311-87a4-fc460e79ccac tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-7578ef72-fe39-47c5-9eab-cdc9ff4122f0" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fe256af0-dda6-4311-87a4-fc460e79ccac tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-7578ef72-fe39-47c5-9eab-cdc9ff4122f0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:00 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fe256af0-dda6-4311-87a4-fc460e79ccac tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-d72bc655-b5bb-4d8f-8b52-bd925e9aa781" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:00 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fe256af0-dda6-4311-87a4-fc460e79ccac tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-d72bc655-b5bb-4d8f-8b52-bd925e9aa781" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-fe256af0-dda6-4311-87a4-fc460e79ccac tempest-ProjectMemberTests-1735269541 None] Deleting offline snapshot d72bc655-b5bb-4d8f-8b52-bd925e9aa781 of volume 7578ef72-fe39-47c5-9eab-cdc9ff4122f0 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-fe256af0-dda6-4311-87a4-fc460e79ccac tempest-ProjectMemberTests-1735269541 None] snapshot_file for this snap is: volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.d72bc655-b5bb-4d8f-8b52-bd925e9aa781 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b772de69-1a1b-4bdc-867e-49ad614290d7]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fe256af0-dda6-4311-87a4-fc460e79ccac tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.d72bc655-b5bb-4d8f-8b52-bd925e9aa781 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:00 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.d72bc655-b5bb-4d8f-8b52-bd925e9aa781 Sep 16 17:58:00 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:00 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-80c54a4b-cd06-4790-8b13-e7fd635b1b0d tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.274s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-80c54a4b-cd06-4790-8b13-e7fd635b1b0d tempest-ProjectReaderTests-1000302715 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:58:00 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-80c54a4b-cd06-4790-8b13-e7fd635b1b0d tempest-ProjectReaderTests-1000302715 None] Deleted volume successfully. Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-80c54a4b-cd06-4790-8b13-e7fd635b1b0d tempest-ProjectReaderTests-1000302715 None] Lock "cinder-9471b7bb-a8a7-44ac-8c13-9243019d76d9-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:00 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fe256af0-dda6-4311-87a4-fc460e79ccac tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.d72bc655-b5bb-4d8f-8b52-bd925e9aa781" returned: 0 in 0.385s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-fe256af0-dda6-4311-87a4-fc460e79ccac tempest-ProjectMemberTests-1735269541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f93108-5fbc-49e5-9535-a70e513f89d9]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fe256af0-dda6-4311-87a4-fc460e79ccac tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:00 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0 Sep 16 17:58:00 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Flow 'volume_create_manager' (a24d3c35-88d4-4d9f-9924-b572eb1d4075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e10311-732d-4da5-b215-286970b383b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e10311-732d-4da5-b215-286970b383b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-80314425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae67bce6-c2c5-40ed-9904-65b3ce41ec3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4b789bddcb41348d6a1edb0b27ddda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:58:01Z,use_quota=True,user_id='90797b4d598d4280a4e5f75e51387205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99202f98-d8bd-4061-a958-6d4a2f84f4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99202f98-d8bd-4061-a958-6d4a2f84f4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885f6f93-1e9b-4792-ad66-83356416575f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885f6f93-1e9b-4792-ad66-83356416575f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae67bce6-c2c5-40ed-9904-65b3ce41ec3a', 'volume_name': 'volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5404267-0943-44d6-b0dc-5a326bda5b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5404267-0943-44d6-b0dc-5a326bda5b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7752048-c0a0-4429-b428-eb6cf162f438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:00 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Volume ae67bce6-c2c5-40ed-9904-65b3ce41ec3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a', 'volume_size': 1} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-80314425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae67bce6-c2c5-40ed-9904-65b3ce41ec3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4b789bddcb41348d6a1edb0b27ddda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:58:01Z,use_quota=True,user_id='90797b4d598d4280a4e5f75e51387205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Creating volume ae67bce6-c2c5-40ed-9904-65b3ce41ec3a {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:58:00 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:58:00 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:00 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a 1073741824 Sep 16 17:58:00 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:01 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fe256af0-dda6-4311-87a4-fc460e79ccac tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0" returned: 0 in 0.384s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fe256af0-dda6-4311-87a4-fc460e79ccac tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.d72bc655-b5bb-4d8f-8b52-bd925e9aa781 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:01 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.d72bc655-b5bb-4d8f-8b52-bd925e9aa781 Sep 16 17:58:01 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:01 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a 1073741824" returned: 0 in 0.446s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:01 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fe256af0-dda6-4311-87a4-fc460e79ccac tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.d72bc655-b5bb-4d8f-8b52-bd925e9aa781" returned: 0 in 0.369s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fe256af0-dda6-4311-87a4-fc460e79ccac tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.d72bc655-b5bb-4d8f-8b52-bd925e9aa781 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:01 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.d72bc655-b5bb-4d8f-8b52-bd925e9aa781 Sep 16 17:58:01 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:01 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a Sep 16 17:58:01 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:01 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-fe256af0-dda6-4311-87a4-fc460e79ccac tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0.d72bc655-b5bb-4d8f-8b52-bd925e9aa781" returned: 0 in 0.252s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fe256af0-dda6-4311-87a4-fc460e79ccac tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-d72bc655-b5bb-4d8f-8b52-bd925e9aa781" released by "_delete_snapshot" :: held 1.511s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fe256af0-dda6-4311-87a4-fc460e79ccac tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-7578ef72-fe39-47c5-9eab-cdc9ff4122f0" released by "delete_snapshot" :: held 1.532s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:01 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a" returned: 0 in 0.267s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:01 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:58:01 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7752048-c0a0-4429-b428-eb6cf162f438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07036b89-0b26-47cc-91c4-5440a302ae78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:01 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Volume volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a (ae67bce6-c2c5-40ed-9904-65b3ce41ec3a): created successfully Sep 16 17:58:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07036b89-0b26-47cc-91c4-5440a302ae78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:01 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Flow 'volume_create_manager' (a24d3c35-88d4-4d9f-9924-b572eb1d4075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:58:01 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-3884d428-cf3e-4989-917f-be4548acad1d tempest-ProjectReaderTests-1000302715 None] Created volume successfully. Sep 16 17:58:01 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-fe256af0-dda6-4311-87a4-fc460e79ccac tempest-ProjectMemberTests-1735269541 None] Created reservations ['f02a5379-9b78-402e-9b89-b94559f90fbd', '8492ff5f-46a7-4c42-a45d-3bfcaee0878f', '96d2408a-2b54-4f04-8672-98c36e716def', 'fbe9a3ee-0de3-4df4-b5ca-49b7ac937ca2'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:58:01 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-fe256af0-dda6-4311-87a4-fc460e79ccac tempest-ProjectMemberTests-1735269541 None] Delete snapshot completed successfully. Sep 16 17:58:01 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-fe256af0-dda6-4311-87a4-fc460e79ccac tempest-ProjectMemberTests-1735269541 None] Lock "cinder-d72bc655-b5bb-4d8f-8b52-bd925e9aa781-delete_snapshot" released by "delete_snapshot" :: held 1.711s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:58:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:58:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:58:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-41261ef6-5a3e-4903-a67e-ad734d538c00 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-7578ef72-fe39-47c5-9eab-cdc9ff4122f0-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:02 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:58:02 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-41261ef6-5a3e-4903-a67e-ad734d538c00 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-7578ef72-fe39-47c5-9eab-cdc9ff4122f0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-41261ef6-5a3e-4903-a67e-ad734d538c00 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-7578ef72-fe39-47c5-9eab-cdc9ff4122f0" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:02 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-41261ef6-5a3e-4903-a67e-ad734d538c00 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-7578ef72-fe39-47c5-9eab-cdc9ff4122f0" acquired by "delete_volume" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:02 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[354ef84a-0786-4aa2-a836-79e83f598852]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-41261ef6-5a3e-4903-a67e-ad734d538c00 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:02 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.282s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:58:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager._thread_info {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:58:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread count: 29 {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:58:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread info: [<_MainThread(MainThread, started 123748124422272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:58:02 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0 Sep 16 17:58:02 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:02 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-41261ef6-5a3e-4903-a67e-ad734d538c00 tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0" returned: 0 in 0.430s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-41261ef6-5a3e-4903-a67e-ad734d538c00 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:02 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0 Sep 16 17:58:02 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:03 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-41261ef6-5a3e-4903-a67e-ad734d538c00 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-7578ef72-fe39-47c5-9eab-cdc9ff4122f0" returned: 0 in 0.283s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-41261ef6-5a3e-4903-a67e-ad734d538c00 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-7578ef72-fe39-47c5-9eab-cdc9ff4122f0" released by "delete_volume" :: held 0.793s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f2f3a6fe-3d37-4ff5-8a98-f607b8be0e4a tempest-ProjectReaderTests-1000302715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f2f3a6fe-3d37-4ff5-8a98-f607b8be0e4a tempest-ProjectReaderTests-1000302715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-f2f3a6fe-3d37-4ff5-8a98-f607b8be0e4a tempest-ProjectReaderTests-1000302715 None] Creating offline snapshot d3d4cca0-d0ca-4f88-b86e-610094bfb5b7 of volume ae67bce6-c2c5-40ed-9904-65b3ce41ec3a {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a3f7c7-680f-437d-9ed2-6609f9ecfc6c]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f2f3a6fe-3d37-4ff5-8a98-f607b8be0e4a tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-41261ef6-5a3e-4903-a67e-ad734d538c00 tempest-ProjectMemberTests-1735269541 None] Created reservations ['43565295-ded0-4315-9b32-508893a8bc19', '82daf700-410b-4b41-b0bb-0d39a52b0db2', '8714b520-c435-4269-a94a-79e5af5df191', 'c81e5db6-fb74-44d7-ac0a-2405ba09fb9f'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:58:03 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a Sep 16 17:58:03 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-41261ef6-5a3e-4903-a67e-ad734d538c00 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-41261ef6-5a3e-4903-a67e-ad734d538c00 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-41261ef6-5a3e-4903-a67e-ad734d538c00 tempest-ProjectMemberTests-1735269541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-41261ef6-5a3e-4903-a67e-ad734d538c00 tempest-ProjectMemberTests-1735269541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-41261ef6-5a3e-4903-a67e-ad734d538c00 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-41261ef6-5a3e-4903-a67e-ad734d538c00 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:03 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:58:03 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:03 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f2f3a6fe-3d37-4ff5-8a98-f607b8be0e4a tempest-ProjectReaderTests-1000302715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a" returned: 0 in 0.384s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f2f3a6fe-3d37-4ff5-8a98-f607b8be0e4a tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.d3d4cca0-d0ca-4f88-b86e-610094bfb5b7 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:03 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.d3d4cca0-d0ca-4f88-b86e-610094bfb5b7 1G Sep 16 17:58:03 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:03 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-41261ef6-5a3e-4903-a67e-ad734d538c00 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.288s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-41261ef6-5a3e-4903-a67e-ad734d538c00 tempest-ProjectMemberTests-1735269541 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:58:03 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-41261ef6-5a3e-4903-a67e-ad734d538c00 tempest-ProjectMemberTests-1735269541 None] Deleted volume successfully. Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-41261ef6-5a3e-4903-a67e-ad734d538c00 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-7578ef72-fe39-47c5-9eab-cdc9ff4122f0-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Flow 'volume_create_manager' (0fe08b74-fde9-40a3-a0bd-13103beb8aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2fca0b-f129-4eff-9a7b-23543c17aba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2fca0b-f129-4eff-9a7b-23543c17aba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-476082790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86c45c52eba4c698ff7edf1ea9c075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:58:04Z,use_quota=True,user_id='ff634f34ed8b49ceaa2f8e9b6bee7419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:03 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1f05909-41eb-4641-b678-c2439d01fb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1f05909-41eb-4641-b678-c2439d01fb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ff56c9-0d93-4de2-95c8-8c494588bf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ff56c9-0d93-4de2-95c8-8c494588bf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd', 'volume_name': 'volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (548f19f4-b834-4f51-a855-83f09b085a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (548f19f4-b834-4f51-a855-83f09b085a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:04 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe6956b-58a5-48b6-a829-30199fa8b569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:04 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Volume 2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd', 'volume_size': 1} Sep 16 17:58:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:04 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f2f3a6fe-3d37-4ff5-8a98-f607b8be0e4a tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.d3d4cca0-d0ca-4f88-b86e-610094bfb5b7 1G" returned: 0 in 0.447s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f2f3a6fe-3d37-4ff5-8a98-f607b8be0e4a tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.d3d4cca0-d0ca-4f88-b86e-610094bfb5b7 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:04 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.d3d4cca0-d0ca-4f88-b86e-610094bfb5b7 Sep 16 17:58:04 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:04 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f2f3a6fe-3d37-4ff5-8a98-f607b8be0e4a tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.d3d4cca0-d0ca-4f88-b86e-610094bfb5b7" returned: 0 in 0.313s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:04 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-f2f3a6fe-3d37-4ff5-8a98-f607b8be0e4a tempest-ProjectReaderTests-1000302715 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.d3d4cca0-d0ca-4f88-b86e-610094bfb5b7 is being set with open permissions: ugo+rw Sep 16 17:58:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f2f3a6fe-3d37-4ff5-8a98-f607b8be0e4a tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.d3d4cca0-d0ca-4f88-b86e-610094bfb5b7 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:04 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.d3d4cca0-d0ca-4f88-b86e-610094bfb5b7 Sep 16 17:58:04 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:04 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f2f3a6fe-3d37-4ff5-8a98-f607b8be0e4a tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.d3d4cca0-d0ca-4f88-b86e-610094bfb5b7" returned: 0 in 0.258s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f2f3a6fe-3d37-4ff5-8a98-f607b8be0e4a tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:04 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.info Sep 16 17:58:04 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:04 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f2f3a6fe-3d37-4ff5-8a98-f607b8be0e4a tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.info" returned: 0 in 0.255s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:04 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-f2f3a6fe-3d37-4ff5-8a98-f607b8be0e4a tempest-ProjectReaderTests-1000302715 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.info is being set with open permissions: ugo+rw Sep 16 17:58:04 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f2f3a6fe-3d37-4ff5-8a98-f607b8be0e4a tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:04 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.info Sep 16 17:58:04 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:05 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f2f3a6fe-3d37-4ff5-8a98-f607b8be0e4a tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.info" returned: 0 in 0.236s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f2f3a6fe-3d37-4ff5-8a98-f607b8be0e4a tempest-ProjectReaderTests-1000302715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.977s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.133s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:05 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-476082790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86c45c52eba4c698ff7edf1ea9c075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:58:04Z,use_quota=True,user_id='ff634f34ed8b49ceaa2f8e9b6bee7419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:58:05 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Creating volume 2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:58:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:05 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:58:05 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:58:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:05 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:58:05 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:58:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:05 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd 1073741824 Sep 16 17:58:05 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:05 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-f2f3a6fe-3d37-4ff5-8a98-f607b8be0e4a tempest-ProjectReaderTests-1000302715 None] Create snapshot completed successfully Sep 16 17:58:05 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd 1073741824" returned: 0 in 0.432s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:05 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd Sep 16 17:58:05 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:05 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd" returned: 0 in 0.243s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:05 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:58:05 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:05 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe6956b-58a5-48b6-a829-30199fa8b569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:05 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4ad878-a65e-4273-809f-a43dfc1e8d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:05 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Volume volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd (2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd): created successfully Sep 16 17:58:05 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4ad878-a65e-4273-809f-a43dfc1e8d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:05 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Flow 'volume_create_manager' (0fe08b74-fde9-40a3-a0bd-13103beb8aff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:58:05 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-2c584e73-f2dd-46bf-8abb-9b363dad7c12 tempest-ProjectMemberTests-1735269541 None] Created volume successfully. Sep 16 17:58:06 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-35600fa2-25cc-43a1-873d-5524614c68a9 tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-d3d4cca0-d0ca-4f88-b86e-610094bfb5b7-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:06 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-35600fa2-25cc-43a1-873d-5524614c68a9 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-d3d4cca0-d0ca-4f88-b86e-610094bfb5b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:06 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-35600fa2-25cc-43a1-873d-5524614c68a9 tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-quobyte-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:06 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-35600fa2-25cc-43a1-873d-5524614c68a9 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:06 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-35600fa2-25cc-43a1-873d-5524614c68a9 tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-quobyte-d3d4cca0-d0ca-4f88-b86e-610094bfb5b7" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:06 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-35600fa2-25cc-43a1-873d-5524614c68a9 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-d3d4cca0-d0ca-4f88-b86e-610094bfb5b7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:06 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-35600fa2-25cc-43a1-873d-5524614c68a9 tempest-ProjectReaderTests-1000302715 None] Deleting offline snapshot d3d4cca0-d0ca-4f88-b86e-610094bfb5b7 of volume ae67bce6-c2c5-40ed-9904-65b3ce41ec3a {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:58:06 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-35600fa2-25cc-43a1-873d-5524614c68a9 tempest-ProjectReaderTests-1000302715 None] snapshot_file for this snap is: volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.d3d4cca0-d0ca-4f88-b86e-610094bfb5b7 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:58:06 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0eff1a-7bc3-40d1-8aa7-901b7be548b8]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-35600fa2-25cc-43a1-873d-5524614c68a9 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.d3d4cca0-d0ca-4f88-b86e-610094bfb5b7 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:06 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.d3d4cca0-d0ca-4f88-b86e-610094bfb5b7 Sep 16 17:58:06 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:06 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-35600fa2-25cc-43a1-873d-5524614c68a9 tempest-ProjectReaderTests-1000302715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.d3d4cca0-d0ca-4f88-b86e-610094bfb5b7" returned: 0 in 0.386s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:06 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-35600fa2-25cc-43a1-873d-5524614c68a9 tempest-ProjectReaderTests-1000302715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:58:06 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2d4835-254f-49a9-894c-ff8b3bed0ab3]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:06 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-35600fa2-25cc-43a1-873d-5524614c68a9 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:06 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a Sep 16 17:58:06 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:07 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-35600fa2-25cc-43a1-873d-5524614c68a9 tempest-ProjectReaderTests-1000302715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a" returned: 0 in 0.379s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-35600fa2-25cc-43a1-873d-5524614c68a9 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.d3d4cca0-d0ca-4f88-b86e-610094bfb5b7 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:07 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.d3d4cca0-d0ca-4f88-b86e-610094bfb5b7 Sep 16 17:58:07 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5e8126af-7707-4351-bb61-c5bfab4e56f3 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5e8126af-7707-4351-bb61-c5bfab4e56f3 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:07 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5e8126af-7707-4351-bb61-c5bfab4e56f3 tempest-ProjectMemberTests-1735269541 None] Creating offline snapshot f6987717-66b9-49bb-a8af-86bc66052e17 of volume 2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:58:07 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[169a11c9-7849-40c2-810c-16fccbe20a23]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e8126af-7707-4351-bb61-c5bfab4e56f3 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:07 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd Sep 16 17:58:07 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:07 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-35600fa2-25cc-43a1-873d-5524614c68a9 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.d3d4cca0-d0ca-4f88-b86e-610094bfb5b7" returned: 0 in 0.360s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-35600fa2-25cc-43a1-873d-5524614c68a9 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.d3d4cca0-d0ca-4f88-b86e-610094bfb5b7 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:07 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.d3d4cca0-d0ca-4f88-b86e-610094bfb5b7 Sep 16 17:58:07 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:07 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e8126af-7707-4351-bb61-c5bfab4e56f3 tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd" returned: 0 in 0.400s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e8126af-7707-4351-bb61-c5bfab4e56f3 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.f6987717-66b9-49bb-a8af-86bc66052e17 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:07 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:07 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-35600fa2-25cc-43a1-873d-5524614c68a9 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a.d3d4cca0-d0ca-4f88-b86e-610094bfb5b7" returned: 0 in 0.269s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:07 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.f6987717-66b9-49bb-a8af-86bc66052e17 1G Sep 16 17:58:07 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:07 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-35600fa2-25cc-43a1-873d-5524614c68a9 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-d3d4cca0-d0ca-4f88-b86e-610094bfb5b7" released by "_delete_snapshot" :: held 1.503s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:07 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-35600fa2-25cc-43a1-873d-5524614c68a9 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a" released by "delete_snapshot" :: held 1.527s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:07 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-35600fa2-25cc-43a1-873d-5524614c68a9 tempest-ProjectReaderTests-1000302715 None] Created reservations ['b9599b63-f721-48fa-8339-abcfb12d7d04', '1042d5a5-c354-46f6-8c63-ce4ee97050df', '94ed56b4-41ef-40b4-9e41-afc85e4a862d', 'eaf915cc-b735-4d8f-b1af-4dc0f1967e4f'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:58:07 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-35600fa2-25cc-43a1-873d-5524614c68a9 tempest-ProjectReaderTests-1000302715 None] Delete snapshot completed successfully. Sep 16 17:58:07 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-35600fa2-25cc-43a1-873d-5524614c68a9 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-d3d4cca0-d0ca-4f88-b86e-610094bfb5b7-delete_snapshot" released by "delete_snapshot" :: held 1.679s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:08 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e8126af-7707-4351-bb61-c5bfab4e56f3 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.f6987717-66b9-49bb-a8af-86bc66052e17 1G" returned: 0 in 0.414s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e8126af-7707-4351-bb61-c5bfab4e56f3 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.f6987717-66b9-49bb-a8af-86bc66052e17 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:08 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.f6987717-66b9-49bb-a8af-86bc66052e17 Sep 16 17:58:08 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a4c771cd-d7db-4d5a-b199-c155b8eb67c1 tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a4c771cd-d7db-4d5a-b199-c155b8eb67c1 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a4c771cd-d7db-4d5a-b199-c155b8eb67c1 tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-quobyte-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:08 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a4c771cd-d7db-4d5a-b199-c155b8eb67c1 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a" acquired by "delete_volume" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:08 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e8126af-7707-4351-bb61-c5bfab4e56f3 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.f6987717-66b9-49bb-a8af-86bc66052e17" returned: 0 in 0.362s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:08 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-5e8126af-7707-4351-bb61-c5bfab4e56f3 tempest-ProjectMemberTests-1735269541 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.f6987717-66b9-49bb-a8af-86bc66052e17 is being set with open permissions: ugo+rw Sep 16 17:58:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e8126af-7707-4351-bb61-c5bfab4e56f3 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.f6987717-66b9-49bb-a8af-86bc66052e17 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:08 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47bacd4-3fe8-4a66-9390-2928f46563e0]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a4c771cd-d7db-4d5a-b199-c155b8eb67c1 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:08 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.f6987717-66b9-49bb-a8af-86bc66052e17 Sep 16 17:58:08 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:08 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a Sep 16 17:58:08 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:08 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e8126af-7707-4351-bb61-c5bfab4e56f3 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.f6987717-66b9-49bb-a8af-86bc66052e17" returned: 0 in 0.270s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e8126af-7707-4351-bb61-c5bfab4e56f3 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:08 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.info Sep 16 17:58:08 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:08 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a4c771cd-d7db-4d5a-b199-c155b8eb67c1 tempest-ProjectReaderTests-1000302715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a" returned: 0 in 0.382s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:08 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a4c771cd-d7db-4d5a-b199-c155b8eb67c1 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:08 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a Sep 16 17:58:08 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:09 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e8126af-7707-4351-bb61-c5bfab4e56f3 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.info" returned: 0 in 0.259s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:09 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-5e8126af-7707-4351-bb61-c5bfab4e56f3 tempest-ProjectMemberTests-1735269541 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.info is being set with open permissions: ugo+rw Sep 16 17:58:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e8126af-7707-4351-bb61-c5bfab4e56f3 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:09 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.info Sep 16 17:58:09 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:09 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a4c771cd-d7db-4d5a-b199-c155b8eb67c1 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a" returned: 0 in 0.258s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:09 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a4c771cd-d7db-4d5a-b199-c155b8eb67c1 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a" released by "delete_volume" :: held 0.717s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:09 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-a4c771cd-d7db-4d5a-b199-c155b8eb67c1 tempest-ProjectReaderTests-1000302715 None] Created reservations ['0e72bf7d-134d-4828-88ff-0f4b32981daa', '28a3b6e8-6acc-4b76-9691-78d340ca3689', 'd137a8ab-5b08-4bb6-8c36-185c368ef43e', '703b4811-9c44-414f-9d57-a6de9ccafa66'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:58:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a4c771cd-d7db-4d5a-b199-c155b8eb67c1 tempest-ProjectReaderTests-1000302715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a4c771cd-d7db-4d5a-b199-c155b8eb67c1 tempest-ProjectReaderTests-1000302715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a4c771cd-d7db-4d5a-b199-c155b8eb67c1 tempest-ProjectReaderTests-1000302715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:58:09 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-a4c771cd-d7db-4d5a-b199-c155b8eb67c1 tempest-ProjectReaderTests-1000302715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:58:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-a4c771cd-d7db-4d5a-b199-c155b8eb67c1 tempest-ProjectReaderTests-1000302715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a4c771cd-d7db-4d5a-b199-c155b8eb67c1 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:09 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:58:09 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:09 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5e8126af-7707-4351-bb61-c5bfab4e56f3 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.info" returned: 0 in 0.274s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5e8126af-7707-4351-bb61-c5bfab4e56f3 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.065s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:09 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5e8126af-7707-4351-bb61-c5bfab4e56f3 tempest-ProjectMemberTests-1735269541 None] Create snapshot completed successfully Sep 16 17:58:09 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:09 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-a4c771cd-d7db-4d5a-b199-c155b8eb67c1 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.277s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:09 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-a4c771cd-d7db-4d5a-b199-c155b8eb67c1 tempest-ProjectReaderTests-1000302715 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:58:09 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-a4c771cd-d7db-4d5a-b199-c155b8eb67c1 tempest-ProjectReaderTests-1000302715 None] Deleted volume successfully. Sep 16 17:58:09 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-a4c771cd-d7db-4d5a-b199-c155b8eb67c1 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-ae67bce6-c2c5-40ed-9904-65b3ce41ec3a-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:09 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:58:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Flow 'volume_create_manager' (28a3e6ac-24e5-4c57-8ba8-d393484b3667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:58:09 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4ae3b5-5aa9-4772-bdeb-1f2e37d002dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4ae3b5-5aa9-4772-bdeb-1f2e37d002dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-579793629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4b789bddcb41348d6a1edb0b27ddda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:58:10Z,use_quota=True,user_id='90797b4d598d4280a4e5f75e51387205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94fd71cc-b13b-4feb-abbb-6e9c50edb74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94fd71cc-b13b-4feb-abbb-6e9c50edb74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5adbfeec-0bc7-4fa1-bc09-909b7a0d7cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5adbfeec-0bc7-4fa1-bc09-909b7a0d7cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3', 'volume_name': 'volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0179483d-cb72-486c-9ccb-9125f87207d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0179483d-cb72-486c-9ccb-9125f87207d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5455a2-90ed-4d16-bc67-5bc937c2a268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:10 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Volume a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3', 'volume_size': 1} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-579793629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4b789bddcb41348d6a1edb0b27ddda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:58:10Z,use_quota=True,user_id='90797b4d598d4280a4e5f75e51387205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Creating volume a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:58:10 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:10 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3 1073741824 Sep 16 17:58:10 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bf51f1d9-2145-4391-bc03-3f9d018ed370 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-f6987717-66b9-49bb-a8af-86bc66052e17-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bf51f1d9-2145-4391-bc03-3f9d018ed370 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-f6987717-66b9-49bb-a8af-86bc66052e17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bf51f1d9-2145-4391-bc03-3f9d018ed370 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bf51f1d9-2145-4391-bc03-3f9d018ed370 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bf51f1d9-2145-4391-bc03-3f9d018ed370 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-f6987717-66b9-49bb-a8af-86bc66052e17" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bf51f1d9-2145-4391-bc03-3f9d018ed370 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-f6987717-66b9-49bb-a8af-86bc66052e17" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-bf51f1d9-2145-4391-bc03-3f9d018ed370 tempest-ProjectMemberTests-1735269541 None] Deleting offline snapshot f6987717-66b9-49bb-a8af-86bc66052e17 of volume 2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-bf51f1d9-2145-4391-bc03-3f9d018ed370 tempest-ProjectMemberTests-1735269541 None] snapshot_file for this snap is: volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.f6987717-66b9-49bb-a8af-86bc66052e17 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:58:10 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3 1073741824" returned: 0 in 0.466s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0c746e-6cca-4aea-bef2-942095d6cbbe]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bf51f1d9-2145-4391-bc03-3f9d018ed370 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.f6987717-66b9-49bb-a8af-86bc66052e17 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:10 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3 Sep 16 17:58:10 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:10 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.f6987717-66b9-49bb-a8af-86bc66052e17 Sep 16 17:58:10 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:10 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3" returned: 0 in 0.252s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5455a2-90ed-4d16-bc67-5bc937c2a268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81330884-4344-4cff-ae18-ccd080a2704d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:10 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Volume volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3 (a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3): created successfully Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81330884-4344-4cff-ae18-ccd080a2704d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Flow 'volume_create_manager' (28a3e6ac-24e5-4c57-8ba8-d393484b3667) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:58:10 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-3b626ffc-100c-4dc8-a64e-adfdde59b094 tempest-ProjectReaderTests-1000302715 None] Created volume successfully. Sep 16 17:58:10 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bf51f1d9-2145-4391-bc03-3f9d018ed370 tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.f6987717-66b9-49bb-a8af-86bc66052e17" returned: 0 in 0.401s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-bf51f1d9-2145-4391-bc03-3f9d018ed370 tempest-ProjectMemberTests-1735269541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27aabe0-eb2e-4bd2-be9b-cfb7204eec29]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:10 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bf51f1d9-2145-4391-bc03-3f9d018ed370 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:11 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd Sep 16 17:58:11 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f61054ec-2971-4918-8e6f-5d4e195407b4 tempest-ProjectReaderTests-1000302715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f61054ec-2971-4918-8e6f-5d4e195407b4 tempest-ProjectReaderTests-1000302715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:11 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-f61054ec-2971-4918-8e6f-5d4e195407b4 tempest-ProjectReaderTests-1000302715 None] Creating offline snapshot 8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0 of volume a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:58:11 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad39c96-2f33-450c-9e4f-ace772161626]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f61054ec-2971-4918-8e6f-5d4e195407b4 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:11 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3 Sep 16 17:58:11 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:11 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bf51f1d9-2145-4391-bc03-3f9d018ed370 tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd" returned: 0 in 0.381s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bf51f1d9-2145-4391-bc03-3f9d018ed370 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.f6987717-66b9-49bb-a8af-86bc66052e17 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:11 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.f6987717-66b9-49bb-a8af-86bc66052e17 Sep 16 17:58:11 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:11 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f61054ec-2971-4918-8e6f-5d4e195407b4 tempest-ProjectReaderTests-1000302715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3" returned: 0 in 0.401s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f61054ec-2971-4918-8e6f-5d4e195407b4 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:11 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0 1G Sep 16 17:58:11 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:11 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bf51f1d9-2145-4391-bc03-3f9d018ed370 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.f6987717-66b9-49bb-a8af-86bc66052e17" returned: 0 in 0.356s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bf51f1d9-2145-4391-bc03-3f9d018ed370 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.f6987717-66b9-49bb-a8af-86bc66052e17 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:11 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.f6987717-66b9-49bb-a8af-86bc66052e17 Sep 16 17:58:11 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:11 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:11 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-bf51f1d9-2145-4391-bc03-3f9d018ed370 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd.f6987717-66b9-49bb-a8af-86bc66052e17" returned: 0 in 0.280s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:12 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f61054ec-2971-4918-8e6f-5d4e195407b4 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0 1G" returned: 0 in 0.413s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f61054ec-2971-4918-8e6f-5d4e195407b4 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:12 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bf51f1d9-2145-4391-bc03-3f9d018ed370 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-f6987717-66b9-49bb-a8af-86bc66052e17" released by "_delete_snapshot" :: held 1.533s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:12 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bf51f1d9-2145-4391-bc03-3f9d018ed370 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd" released by "delete_snapshot" :: held 1.560s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:12 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0 Sep 16 17:58:12 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:12 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-bf51f1d9-2145-4391-bc03-3f9d018ed370 tempest-ProjectMemberTests-1735269541 None] Created reservations ['d17e8427-f918-4f3c-8a25-a07fbc6b592a', '6b364530-aa8b-4675-8948-5dc8bf69e77f', 'ee327a00-09cd-4ff2-91d1-26a1f147827c', 'f91dab53-0097-4026-9b87-a6f1321b1279'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:58:12 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-bf51f1d9-2145-4391-bc03-3f9d018ed370 tempest-ProjectMemberTests-1735269541 None] Delete snapshot completed successfully. Sep 16 17:58:12 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-bf51f1d9-2145-4391-bc03-3f9d018ed370 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-f6987717-66b9-49bb-a8af-86bc66052e17-delete_snapshot" released by "delete_snapshot" :: held 1.736s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:12 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f61054ec-2971-4918-8e6f-5d4e195407b4 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0" returned: 0 in 0.312s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:12 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-f61054ec-2971-4918-8e6f-5d4e195407b4 tempest-ProjectReaderTests-1000302715 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0 is being set with open permissions: ugo+rw Sep 16 17:58:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f61054ec-2971-4918-8e6f-5d4e195407b4 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:12 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0 Sep 16 17:58:12 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:12 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:12 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-adf7f819-56a8-4347-88b7-f6c4c6312514 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f61054ec-2971-4918-8e6f-5d4e195407b4 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0" returned: 0 in 0.266s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:12 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-adf7f819-56a8-4347-88b7-f6c4c6312514 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f61054ec-2971-4918-8e6f-5d4e195407b4 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:12 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.info Sep 16 17:58:12 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:12 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-adf7f819-56a8-4347-88b7-f6c4c6312514 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:12 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-adf7f819-56a8-4347-88b7-f6c4c6312514 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd" acquired by "delete_volume" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:12 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a4064a-cbb7-4d74-821e-9a31f5a6807e]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-adf7f819-56a8-4347-88b7-f6c4c6312514 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:12 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd Sep 16 17:58:12 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:12 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f61054ec-2971-4918-8e6f-5d4e195407b4 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.info" returned: 0 in 0.273s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:12 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-f61054ec-2971-4918-8e6f-5d4e195407b4 tempest-ProjectReaderTests-1000302715 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.info is being set with open permissions: ugo+rw Sep 16 17:58:12 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f61054ec-2971-4918-8e6f-5d4e195407b4 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:12 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.info Sep 16 17:58:12 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:13 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-adf7f819-56a8-4347-88b7-f6c4c6312514 tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd" returned: 0 in 0.381s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-adf7f819-56a8-4347-88b7-f6c4c6312514 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:13 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd Sep 16 17:58:13 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:13 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-f61054ec-2971-4918-8e6f-5d4e195407b4 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.info" returned: 0 in 0.269s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-f61054ec-2971-4918-8e6f-5d4e195407b4 tempest-ProjectReaderTests-1000302715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.042s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:13 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=178,cinder:INSERT=69,cinder:UPDATE=225,cinder:DELETE=20 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:58:13 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:UPDATE=229,cinder:DELETE=19,cinder:SELECT=183,cinder:INSERT=54 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:58:13 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-f61054ec-2971-4918-8e6f-5d4e195407b4 tempest-ProjectReaderTests-1000302715 None] Create snapshot completed successfully Sep 16 17:58:13 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-adf7f819-56a8-4347-88b7-f6c4c6312514 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd" returned: 0 in 0.269s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:13 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-adf7f819-56a8-4347-88b7-f6c4c6312514 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd" released by "delete_volume" :: held 0.708s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:13 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-adf7f819-56a8-4347-88b7-f6c4c6312514 tempest-ProjectMemberTests-1735269541 None] Created reservations ['35ccf5e3-91f0-4848-8503-0ea36150462a', 'bbe351f8-05fd-4489-bac5-e96c94e7f376', '3799102e-1c09-441f-bbd2-6fc6730d0be8', 'd4ac1e49-2e82-4b9f-b9da-e41e78935c0e'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:58:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-adf7f819-56a8-4347-88b7-f6c4c6312514 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-adf7f819-56a8-4347-88b7-f6c4c6312514 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:13 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-adf7f819-56a8-4347-88b7-f6c4c6312514 tempest-ProjectMemberTests-1735269541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:58:13 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-adf7f819-56a8-4347-88b7-f6c4c6312514 tempest-ProjectMemberTests-1735269541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:58:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-adf7f819-56a8-4347-88b7-f6c4c6312514 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-adf7f819-56a8-4347-88b7-f6c4c6312514 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:13 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:58:13 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:13 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:13 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-adf7f819-56a8-4347-88b7-f6c4c6312514 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.255s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:13 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-adf7f819-56a8-4347-88b7-f6c4c6312514 tempest-ProjectMemberTests-1735269541 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:58:13 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-adf7f819-56a8-4347-88b7-f6c4c6312514 tempest-ProjectMemberTests-1735269541 None] Deleted volume successfully. Sep 16 17:58:13 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-adf7f819-56a8-4347-88b7-f6c4c6312514 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-2ec28fb3-ebc4-4468-9312-f3dec8e0c1fd-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Flow 'volume_create_manager' (94af7e69-ee5f-4219-8d7f-98f4b797f481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1691c7f3-80a0-4324-aeea-2c97b5f326d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1691c7f3-80a0-4324-aeea-2c97b5f326d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-476210752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732b4aba-5a94-48a9-b76c-d6c430f0d932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86c45c52eba4c698ff7edf1ea9c075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:58:14Z,use_quota=True,user_id='ff634f34ed8b49ceaa2f8e9b6bee7419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8e18dd-5d21-4703-90da-eac006b271b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8e18dd-5d21-4703-90da-eac006b271b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3b57bf-e1c0-4fd5-88a6-091e31101011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3b57bf-e1c0-4fd5-88a6-091e31101011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '732b4aba-5a94-48a9-b76c-d6c430f0d932', 'volume_name': 'volume-732b4aba-5a94-48a9-b76c-d6c430f0d932', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761bfe0c-85bd-4685-920c-9d876b5cdc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761bfe0c-85bd-4685-920c-9d876b5cdc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01653b2c-8ad5-4e50-9176-9667a7fda3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:14 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Volume 732b4aba-5a94-48a9-b76c-d6c430f0d932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-732b4aba-5a94-48a9-b76c-d6c430f0d932', 'volume_size': 1} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-476210752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732b4aba-5a94-48a9-b76c-d6c430f0d932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86c45c52eba4c698ff7edf1ea9c075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:58:14Z,use_quota=True,user_id='ff634f34ed8b49ceaa2f8e9b6bee7419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Creating volume 732b4aba-5a94-48a9-b76c-d6c430f0d932 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:58:14 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-edcca0ae-b376-45b5-86fe-3795fa7d2c5a tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:14 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932 1073741824 Sep 16 17:58:14 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-edcca0ae-b376-45b5-86fe-3795fa7d2c5a tempest-ProjectReaderTests-1000302715 None] Lock "cinder-8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-edcca0ae-b376-45b5-86fe-3795fa7d2c5a tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-quobyte-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-edcca0ae-b376-45b5-86fe-3795fa7d2c5a tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-edcca0ae-b376-45b5-86fe-3795fa7d2c5a tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-quobyte-8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-edcca0ae-b376-45b5-86fe-3795fa7d2c5a tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-edcca0ae-b376-45b5-86fe-3795fa7d2c5a tempest-ProjectReaderTests-1000302715 None] Deleting offline snapshot 8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0 of volume a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-edcca0ae-b376-45b5-86fe-3795fa7d2c5a tempest-ProjectReaderTests-1000302715 None] snapshot_file for this snap is: volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d036269-7c10-40f6-8b7b-fcbc49e39e6a]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-edcca0ae-b376-45b5-86fe-3795fa7d2c5a tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:14 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0 Sep 16 17:58:14 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:14 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932 1073741824" returned: 0 in 0.426s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:14 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932 Sep 16 17:58:14 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:14 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-edcca0ae-b376-45b5-86fe-3795fa7d2c5a tempest-ProjectReaderTests-1000302715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0" returned: 0 in 0.405s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-edcca0ae-b376-45b5-86fe-3795fa7d2c5a tempest-ProjectReaderTests-1000302715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bea95a-7647-4cc1-81ac-af261f6838a3]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:14 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-edcca0ae-b376-45b5-86fe-3795fa7d2c5a tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:14 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3 Sep 16 17:58:14 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:15 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932" returned: 0 in 0.276s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:58:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01653b2c-8ad5-4e50-9176-9667a7fda3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-732b4aba-5a94-48a9-b76c-d6c430f0d932', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca91016a-2481-4f1a-8a76-80f94f5827fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:15 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Volume volume-732b4aba-5a94-48a9-b76c-d6c430f0d932 (732b4aba-5a94-48a9-b76c-d6c430f0d932): created successfully Sep 16 17:58:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca91016a-2481-4f1a-8a76-80f94f5827fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:15 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Flow 'volume_create_manager' (94af7e69-ee5f-4219-8d7f-98f4b797f481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:58:15 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5319057d-bb2d-4f81-93f2-68e6562f02a5 tempest-ProjectMemberTests-1735269541 None] Created volume successfully. Sep 16 17:58:15 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-edcca0ae-b376-45b5-86fe-3795fa7d2c5a tempest-ProjectReaderTests-1000302715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3" returned: 0 in 0.382s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-edcca0ae-b376-45b5-86fe-3795fa7d2c5a tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:15 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0 Sep 16 17:58:15 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1093e640-178c-4781-aa0f-d9d48495f3a1 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1093e640-178c-4781-aa0f-d9d48495f3a1 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:15 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-1093e640-178c-4781-aa0f-d9d48495f3a1 tempest-ProjectMemberTests-1735269541 None] Creating offline snapshot 80914166-2c9d-4b95-bfd5-8e1e9e502f21 of volume 732b4aba-5a94-48a9-b76c-d6c430f0d932 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:58:15 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b4d349-afc6-4e66-ad65-2ded5e74af31]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1093e640-178c-4781-aa0f-d9d48495f3a1 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:15 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932 Sep 16 17:58:15 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:15 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-edcca0ae-b376-45b5-86fe-3795fa7d2c5a tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0" returned: 0 in 0.360s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-edcca0ae-b376-45b5-86fe-3795fa7d2c5a tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:15 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0 Sep 16 17:58:15 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:15 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1093e640-178c-4781-aa0f-d9d48495f3a1 tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932" returned: 0 in 0.382s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1093e640-178c-4781-aa0f-d9d48495f3a1 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.80914166-2c9d-4b95-bfd5-8e1e9e502f21 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:15 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.80914166-2c9d-4b95-bfd5-8e1e9e502f21 1G Sep 16 17:58:15 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:15 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:15 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-edcca0ae-b376-45b5-86fe-3795fa7d2c5a tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3.8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0" returned: 0 in 0.263s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:15 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-edcca0ae-b376-45b5-86fe-3795fa7d2c5a tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0" released by "_delete_snapshot" :: held 1.521s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:15 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-edcca0ae-b376-45b5-86fe-3795fa7d2c5a tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3" released by "delete_snapshot" :: held 1.541s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:15 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-edcca0ae-b376-45b5-86fe-3795fa7d2c5a tempest-ProjectReaderTests-1000302715 None] Created reservations ['789125b0-2d11-4cbb-83fe-66759df298fe', '0c7bb19c-8c8f-416e-b194-010756a8fcd6', 'e04498d3-3900-4c79-ae07-a46f3c711234', '95914e14-695b-42be-abef-84a6db2862df'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:58:16 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-edcca0ae-b376-45b5-86fe-3795fa7d2c5a tempest-ProjectReaderTests-1000302715 None] Delete snapshot completed successfully. Sep 16 17:58:16 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-edcca0ae-b376-45b5-86fe-3795fa7d2c5a tempest-ProjectReaderTests-1000302715 None] Lock "cinder-8f39cfff-75f0-4d8b-ad6a-938a4b0be6d0-delete_snapshot" released by "delete_snapshot" :: held 1.682s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:16 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1093e640-178c-4781-aa0f-d9d48495f3a1 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.80914166-2c9d-4b95-bfd5-8e1e9e502f21 1G" returned: 0 in 0.397s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1093e640-178c-4781-aa0f-d9d48495f3a1 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-732b4aba-5a94-48a9-b76c-d6c430f0d932 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.80914166-2c9d-4b95-bfd5-8e1e9e502f21 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:16 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-732b4aba-5a94-48a9-b76c-d6c430f0d932 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.80914166-2c9d-4b95-bfd5-8e1e9e502f21 Sep 16 17:58:16 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:16 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-66096a48-0713-4a1a-8524-1164596f41f7 tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:16 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-66096a48-0713-4a1a-8524-1164596f41f7 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:16 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1093e640-178c-4781-aa0f-d9d48495f3a1 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-732b4aba-5a94-48a9-b76c-d6c430f0d932 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.80914166-2c9d-4b95-bfd5-8e1e9e502f21" returned: 0 in 0.312s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:16 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-1093e640-178c-4781-aa0f-d9d48495f3a1 tempest-ProjectMemberTests-1735269541 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.80914166-2c9d-4b95-bfd5-8e1e9e502f21 is being set with open permissions: ugo+rw Sep 16 17:58:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1093e640-178c-4781-aa0f-d9d48495f3a1 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.80914166-2c9d-4b95-bfd5-8e1e9e502f21 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:16 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.80914166-2c9d-4b95-bfd5-8e1e9e502f21 Sep 16 17:58:16 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:16 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-66096a48-0713-4a1a-8524-1164596f41f7 tempest-ProjectReaderTests-1000302715 None] Acquiring lock "cinder-quobyte-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:16 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-66096a48-0713-4a1a-8524-1164596f41f7 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:16 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[020cec80-756b-43c8-a8e4-b6d1e57d181c]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-66096a48-0713-4a1a-8524-1164596f41f7 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:16 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3 Sep 16 17:58:16 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:16 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1093e640-178c-4781-aa0f-d9d48495f3a1 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.80914166-2c9d-4b95-bfd5-8e1e9e502f21" returned: 0 in 0.264s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:16 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1093e640-178c-4781-aa0f-d9d48495f3a1 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:16 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.info Sep 16 17:58:16 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:17 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-66096a48-0713-4a1a-8524-1164596f41f7 tempest-ProjectReaderTests-1000302715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3" returned: 0 in 0.376s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-66096a48-0713-4a1a-8524-1164596f41f7 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:17 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3 Sep 16 17:58:17 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:17 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1093e640-178c-4781-aa0f-d9d48495f3a1 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.info" returned: 0 in 0.264s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:17 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-1093e640-178c-4781-aa0f-d9d48495f3a1 tempest-ProjectMemberTests-1735269541 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.info is being set with open permissions: ugo+rw Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1093e640-178c-4781-aa0f-d9d48495f3a1 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:17 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.info Sep 16 17:58:17 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:17 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-66096a48-0713-4a1a-8524-1164596f41f7 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3" returned: 0 in 0.281s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-66096a48-0713-4a1a-8524-1164596f41f7 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-quobyte-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3" released by "delete_volume" :: held 0.726s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:17 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1093e640-178c-4781-aa0f-d9d48495f3a1 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.info" returned: 0 in 0.258s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1093e640-178c-4781-aa0f-d9d48495f3a1 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.965s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:17 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-1093e640-178c-4781-aa0f-d9d48495f3a1 tempest-ProjectMemberTests-1735269541 None] Create snapshot completed successfully Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-66096a48-0713-4a1a-8524-1164596f41f7 tempest-ProjectReaderTests-1000302715 None] Created reservations ['f32c0849-faf0-41ab-9a19-d6af34bf67a3', '3afc8fe3-d59b-4d08-b686-6931ed6c3fcf', '01ea2d2a-e5b7-4b4f-a154-0e3a2e2f6867', 'f0d6e52e-f32d-4b47-aa5c-eaf140878807'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-66096a48-0713-4a1a-8524-1164596f41f7 tempest-ProjectReaderTests-1000302715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-66096a48-0713-4a1a-8524-1164596f41f7 tempest-ProjectReaderTests-1000302715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-66096a48-0713-4a1a-8524-1164596f41f7 tempest-ProjectReaderTests-1000302715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-66096a48-0713-4a1a-8524-1164596f41f7 tempest-ProjectReaderTests-1000302715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-66096a48-0713-4a1a-8524-1164596f41f7 tempest-ProjectReaderTests-1000302715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-66096a48-0713-4a1a-8524-1164596f41f7 tempest-ProjectReaderTests-1000302715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:17 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:58:17 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-df645bc9-9ab5-4607-8793-8443be281a84 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-80914166-2c9d-4b95-bfd5-8e1e9e502f21-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-df645bc9-9ab5-4607-8793-8443be281a84 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-80914166-2c9d-4b95-bfd5-8e1e9e502f21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-df645bc9-9ab5-4607-8793-8443be281a84 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-732b4aba-5a94-48a9-b76c-d6c430f0d932" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-df645bc9-9ab5-4607-8793-8443be281a84 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-732b4aba-5a94-48a9-b76c-d6c430f0d932" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-df645bc9-9ab5-4607-8793-8443be281a84 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-80914166-2c9d-4b95-bfd5-8e1e9e502f21" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-df645bc9-9ab5-4607-8793-8443be281a84 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-80914166-2c9d-4b95-bfd5-8e1e9e502f21" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-df645bc9-9ab5-4607-8793-8443be281a84 tempest-ProjectMemberTests-1735269541 None] Deleting offline snapshot 80914166-2c9d-4b95-bfd5-8e1e9e502f21 of volume 732b4aba-5a94-48a9-b76c-d6c430f0d932 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-df645bc9-9ab5-4607-8793-8443be281a84 tempest-ProjectMemberTests-1735269541 None] snapshot_file for this snap is: volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.80914166-2c9d-4b95-bfd5-8e1e9e502f21 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96a1b2d-6933-454d-b2b4-da4ac90942bd]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df645bc9-9ab5-4607-8793-8443be281a84 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.80914166-2c9d-4b95-bfd5-8e1e9e502f21 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:17 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.80914166-2c9d-4b95-bfd5-8e1e9e502f21 Sep 16 17:58:17 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:17 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-66096a48-0713-4a1a-8524-1164596f41f7 tempest-ProjectReaderTests-1000302715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.279s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-66096a48-0713-4a1a-8524-1164596f41f7 tempest-ProjectReaderTests-1000302715 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:58:17 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-66096a48-0713-4a1a-8524-1164596f41f7 tempest-ProjectReaderTests-1000302715 None] Deleted volume successfully. Sep 16 17:58:17 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-66096a48-0713-4a1a-8524-1164596f41f7 tempest-ProjectReaderTests-1000302715 None] Lock "cinder-a83f9cd7-0a1f-4917-b6cb-629a9b3bb1b3-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:18 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df645bc9-9ab5-4607-8793-8443be281a84 tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.80914166-2c9d-4b95-bfd5-8e1e9e502f21" returned: 0 in 0.381s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:18 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-df645bc9-9ab5-4607-8793-8443be281a84 tempest-ProjectMemberTests-1735269541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-732b4aba-5a94-48a9-b76c-d6c430f0d932(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:58:18 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42bfb13-e4d8-4d32-81b9-529c4945d8c4]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df645bc9-9ab5-4607-8793-8443be281a84 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:18 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932 Sep 16 17:58:18 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:18 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df645bc9-9ab5-4607-8793-8443be281a84 tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932" returned: 0 in 0.392s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df645bc9-9ab5-4607-8793-8443be281a84 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.80914166-2c9d-4b95-bfd5-8e1e9e502f21 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:18 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.80914166-2c9d-4b95-bfd5-8e1e9e502f21 Sep 16 17:58:18 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:18 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df645bc9-9ab5-4607-8793-8443be281a84 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.80914166-2c9d-4b95-bfd5-8e1e9e502f21" returned: 0 in 0.386s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:18 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df645bc9-9ab5-4607-8793-8443be281a84 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.80914166-2c9d-4b95-bfd5-8e1e9e502f21 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:18 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.80914166-2c9d-4b95-bfd5-8e1e9e502f21 Sep 16 17:58:18 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:19 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-df645bc9-9ab5-4607-8793-8443be281a84 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932.80914166-2c9d-4b95-bfd5-8e1e9e502f21" returned: 0 in 0.280s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:19 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-df645bc9-9ab5-4607-8793-8443be281a84 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-80914166-2c9d-4b95-bfd5-8e1e9e502f21" released by "_delete_snapshot" :: held 1.563s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:19 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-df645bc9-9ab5-4607-8793-8443be281a84 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-732b4aba-5a94-48a9-b76c-d6c430f0d932" released by "delete_snapshot" :: held 1.589s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:19 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-df645bc9-9ab5-4607-8793-8443be281a84 tempest-ProjectMemberTests-1735269541 None] Created reservations ['1915af60-3a34-4e51-9c9e-0761c6b68fb2', '7e3b4fc5-8e81-4019-9689-68d7c70cf2bc', 'aeb729a1-085f-44e4-8464-c2d98615aa2b', '05aac85f-39a5-4a1d-9729-ee63c9cc7d09'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:58:19 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-df645bc9-9ab5-4607-8793-8443be281a84 tempest-ProjectMemberTests-1735269541 None] Delete snapshot completed successfully. Sep 16 17:58:19 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-df645bc9-9ab5-4607-8793-8443be281a84 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-80914166-2c9d-4b95-bfd5-8e1e9e502f21-delete_snapshot" released by "delete_snapshot" :: held 1.731s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:19 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-22a02a31-d812-4bf4-91fe-db3bc70e10bb tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-732b4aba-5a94-48a9-b76c-d6c430f0d932-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:19 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-22a02a31-d812-4bf4-91fe-db3bc70e10bb tempest-ProjectMemberTests-1735269541 None] Lock "cinder-732b4aba-5a94-48a9-b76c-d6c430f0d932-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:19 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-22a02a31-d812-4bf4-91fe-db3bc70e10bb tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-732b4aba-5a94-48a9-b76c-d6c430f0d932" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:19 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-22a02a31-d812-4bf4-91fe-db3bc70e10bb tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-732b4aba-5a94-48a9-b76c-d6c430f0d932" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:19 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[810c3cd1-430a-4c61-b221-cd7711b65e2f]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:19 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-22a02a31-d812-4bf4-91fe-db3bc70e10bb tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:19 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932 Sep 16 17:58:19 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:20 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-22a02a31-d812-4bf4-91fe-db3bc70e10bb tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932" returned: 0 in 0.388s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-22a02a31-d812-4bf4-91fe-db3bc70e10bb tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:20 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932 Sep 16 17:58:20 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:20 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-22a02a31-d812-4bf4-91fe-db3bc70e10bb tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-732b4aba-5a94-48a9-b76c-d6c430f0d932" returned: 0 in 0.255s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-22a02a31-d812-4bf4-91fe-db3bc70e10bb tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-732b4aba-5a94-48a9-b76c-d6c430f0d932" released by "delete_volume" :: held 0.725s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:20 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-22a02a31-d812-4bf4-91fe-db3bc70e10bb tempest-ProjectMemberTests-1735269541 None] Created reservations ['f0a41793-57a4-4e3d-a400-c60a99be4975', 'b0fd6206-a16d-427e-bda3-da6e975a9462', 'bf64f2b9-7978-4b51-830e-3561e7745fac', 'b77dc61f-1698-4e90-9da7-f417e0f9cd36'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:58:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-22a02a31-d812-4bf4-91fe-db3bc70e10bb tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-22a02a31-d812-4bf4-91fe-db3bc70e10bb tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-22a02a31-d812-4bf4-91fe-db3bc70e10bb tempest-ProjectMemberTests-1735269541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:58:20 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-22a02a31-d812-4bf4-91fe-db3bc70e10bb tempest-ProjectMemberTests-1735269541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:58:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-22a02a31-d812-4bf4-91fe-db3bc70e10bb tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-22a02a31-d812-4bf4-91fe-db3bc70e10bb tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:20 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:58:20 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:20 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:20 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-22a02a31-d812-4bf4-91fe-db3bc70e10bb tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.286s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:20 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-22a02a31-d812-4bf4-91fe-db3bc70e10bb tempest-ProjectMemberTests-1735269541 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:58:20 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-22a02a31-d812-4bf4-91fe-db3bc70e10bb tempest-ProjectMemberTests-1735269541 None] Deleted volume successfully. Sep 16 17:58:20 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-22a02a31-d812-4bf4-91fe-db3bc70e10bb tempest-ProjectMemberTests-1735269541 None] Lock "cinder-732b4aba-5a94-48a9-b76c-d6c430f0d932-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Flow 'volume_create_manager' (21dfc65d-f420-4309-8da5-44c943a94b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4f821c-d635-44fe-99aa-ebea94ac2f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4f821c-d635-44fe-99aa-ebea94ac2f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1249349344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691b3f89-ab28-42ad-833c-fe66be5b65e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86c45c52eba4c698ff7edf1ea9c075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:58:21Z,use_quota=True,user_id='ff634f34ed8b49ceaa2f8e9b6bee7419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca395a67-063a-4ef6-8c86-9fa51bff4a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca395a67-063a-4ef6-8c86-9fa51bff4a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a4f980-3a3d-4b1d-9977-9f2955da5875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a4f980-3a3d-4b1d-9977-9f2955da5875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '691b3f89-ab28-42ad-833c-fe66be5b65e7', 'volume_name': 'volume-691b3f89-ab28-42ad-833c-fe66be5b65e7', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43a066da-c5b5-4caf-92cc-0785fd9ac00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43a066da-c5b5-4caf-92cc-0785fd9ac00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e07ac3-9b1c-40fc-bd6e-24dbc84289c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:21 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Volume 691b3f89-ab28-42ad-833c-fe66be5b65e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-691b3f89-ab28-42ad-833c-fe66be5b65e7', 'volume_size': 1} Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1249349344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691b3f89-ab28-42ad-833c-fe66be5b65e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86c45c52eba4c698ff7edf1ea9c075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:58:21Z,use_quota=True,user_id='ff634f34ed8b49ceaa2f8e9b6bee7419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Creating volume 691b3f89-ab28-42ad-833c-fe66be5b65e7 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:58:21 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:21 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7 1073741824 Sep 16 17:58:21 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:21 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7 1073741824" returned: 0 in 0.432s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:21 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:21 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7 Sep 16 17:58:21 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:22 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7" returned: 0 in 0.253s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:58:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e07ac3-9b1c-40fc-bd6e-24dbc84289c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-691b3f89-ab28-42ad-833c-fe66be5b65e7', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1860020-7db7-4729-9966-271c29a8dc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:22 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Volume volume-691b3f89-ab28-42ad-833c-fe66be5b65e7 (691b3f89-ab28-42ad-833c-fe66be5b65e7): created successfully Sep 16 17:58:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1860020-7db7-4729-9966-271c29a8dc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:22 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Flow 'volume_create_manager' (21dfc65d-f420-4309-8da5-44c943a94b34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:58:22 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-373c4c0b-f4a6-4f3c-8704-719e34b2df9a tempest-ProjectMemberTests-1735269541 None] Created volume successfully. Sep 16 17:58:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1c7a576a-0a55-4122-8204-54c6c477bb46 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1c7a576a-0a55-4122-8204-54c6c477bb46 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:22 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-1c7a576a-0a55-4122-8204-54c6c477bb46 tempest-ProjectMemberTests-1735269541 None] Creating offline snapshot 49f569d1-3067-4454-b872-bc5b920d6f45 of volume 691b3f89-ab28-42ad-833c-fe66be5b65e7 {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:58:22 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8854d434-9db6-4b3f-a77e-d360e02ce9ec]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1c7a576a-0a55-4122-8204-54c6c477bb46 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:22 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7 Sep 16 17:58:22 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:22 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1c7a576a-0a55-4122-8204-54c6c477bb46 tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7" returned: 0 in 0.385s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:22 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1c7a576a-0a55-4122-8204-54c6c477bb46 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.49f569d1-3067-4454-b872-bc5b920d6f45 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:23 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.49f569d1-3067-4454-b872-bc5b920d6f45 1G Sep 16 17:58:23 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:23 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1c7a576a-0a55-4122-8204-54c6c477bb46 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.49f569d1-3067-4454-b872-bc5b920d6f45 1G" returned: 0 in 0.378s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1c7a576a-0a55-4122-8204-54c6c477bb46 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-691b3f89-ab28-42ad-833c-fe66be5b65e7 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.49f569d1-3067-4454-b872-bc5b920d6f45 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:23 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-691b3f89-ab28-42ad-833c-fe66be5b65e7 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.49f569d1-3067-4454-b872-bc5b920d6f45 Sep 16 17:58:23 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:23 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1c7a576a-0a55-4122-8204-54c6c477bb46 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-691b3f89-ab28-42ad-833c-fe66be5b65e7 -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.49f569d1-3067-4454-b872-bc5b920d6f45" returned: 0 in 0.293s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:23 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-1c7a576a-0a55-4122-8204-54c6c477bb46 tempest-ProjectMemberTests-1735269541 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.49f569d1-3067-4454-b872-bc5b920d6f45 is being set with open permissions: ugo+rw Sep 16 17:58:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1c7a576a-0a55-4122-8204-54c6c477bb46 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.49f569d1-3067-4454-b872-bc5b920d6f45 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:23 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.49f569d1-3067-4454-b872-bc5b920d6f45 Sep 16 17:58:23 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:23 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1c7a576a-0a55-4122-8204-54c6c477bb46 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.49f569d1-3067-4454-b872-bc5b920d6f45" returned: 0 in 0.264s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:23 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1c7a576a-0a55-4122-8204-54c6c477bb46 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:23 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.info Sep 16 17:58:23 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:24 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1c7a576a-0a55-4122-8204-54c6c477bb46 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.info" returned: 0 in 0.253s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:24 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-1c7a576a-0a55-4122-8204-54c6c477bb46 tempest-ProjectMemberTests-1735269541 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.info is being set with open permissions: ugo+rw Sep 16 17:58:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1c7a576a-0a55-4122-8204-54c6c477bb46 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:24 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.info Sep 16 17:58:24 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:24 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1c7a576a-0a55-4122-8204-54c6c477bb46 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.info" returned: 0 in 0.272s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1c7a576a-0a55-4122-8204-54c6c477bb46 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.941s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:24 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-1c7a576a-0a55-4122-8204-54c6c477bb46 tempest-ProjectMemberTests-1735269541 None] Create snapshot completed successfully Sep 16 17:58:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5c8c1083-a235-4f93-b70e-216bc3eef197 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-49f569d1-3067-4454-b872-bc5b920d6f45-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5c8c1083-a235-4f93-b70e-216bc3eef197 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-49f569d1-3067-4454-b872-bc5b920d6f45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5c8c1083-a235-4f93-b70e-216bc3eef197 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-691b3f89-ab28-42ad-833c-fe66be5b65e7" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5c8c1083-a235-4f93-b70e-216bc3eef197 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-691b3f89-ab28-42ad-833c-fe66be5b65e7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5c8c1083-a235-4f93-b70e-216bc3eef197 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-49f569d1-3067-4454-b872-bc5b920d6f45" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:24 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5c8c1083-a235-4f93-b70e-216bc3eef197 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-49f569d1-3067-4454-b872-bc5b920d6f45" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5c8c1083-a235-4f93-b70e-216bc3eef197 tempest-ProjectMemberTests-1735269541 None] Deleting offline snapshot 49f569d1-3067-4454-b872-bc5b920d6f45 of volume 691b3f89-ab28-42ad-833c-fe66be5b65e7 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:58:24 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5c8c1083-a235-4f93-b70e-216bc3eef197 tempest-ProjectMemberTests-1735269541 None] snapshot_file for this snap is: volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.49f569d1-3067-4454-b872-bc5b920d6f45 {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:58:24 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b325d3df-bd9e-49a9-975f-c5c0e0b254c8]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:24 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5c8c1083-a235-4f93-b70e-216bc3eef197 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.49f569d1-3067-4454-b872-bc5b920d6f45 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:24 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.49f569d1-3067-4454-b872-bc5b920d6f45 Sep 16 17:58:24 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:25 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5c8c1083-a235-4f93-b70e-216bc3eef197 tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.49f569d1-3067-4454-b872-bc5b920d6f45" returned: 0 in 0.375s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:25 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-5c8c1083-a235-4f93-b70e-216bc3eef197 tempest-ProjectMemberTests-1735269541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-691b3f89-ab28-42ad-833c-fe66be5b65e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:58:25 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42cd1d7-ea93-4bea-a5c5-e0c7929ab80d]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5c8c1083-a235-4f93-b70e-216bc3eef197 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:25 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7 Sep 16 17:58:25 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:25 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5c8c1083-a235-4f93-b70e-216bc3eef197 tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7" returned: 0 in 0.393s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5c8c1083-a235-4f93-b70e-216bc3eef197 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.49f569d1-3067-4454-b872-bc5b920d6f45 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:25 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.49f569d1-3067-4454-b872-bc5b920d6f45 Sep 16 17:58:25 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:25 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5c8c1083-a235-4f93-b70e-216bc3eef197 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.49f569d1-3067-4454-b872-bc5b920d6f45" returned: 0 in 0.373s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:25 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5c8c1083-a235-4f93-b70e-216bc3eef197 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.49f569d1-3067-4454-b872-bc5b920d6f45 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:26 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.49f569d1-3067-4454-b872-bc5b920d6f45 Sep 16 17:58:26 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:26 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:26 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-5c8c1083-a235-4f93-b70e-216bc3eef197 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7.49f569d1-3067-4454-b872-bc5b920d6f45" returned: 0 in 0.275s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:26 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5c8c1083-a235-4f93-b70e-216bc3eef197 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-49f569d1-3067-4454-b872-bc5b920d6f45" released by "_delete_snapshot" :: held 1.523s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:26 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5c8c1083-a235-4f93-b70e-216bc3eef197 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-691b3f89-ab28-42ad-833c-fe66be5b65e7" released by "delete_snapshot" :: held 1.552s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:26 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-5c8c1083-a235-4f93-b70e-216bc3eef197 tempest-ProjectMemberTests-1735269541 None] Created reservations ['b88a4a41-59ef-4d70-a7a0-ebcb187de181', '5466452f-015a-4d6c-a63c-79c4d0bec62b', 'c9ce04df-27b5-45f9-8de8-e6ee77af4bc0', '5226bf54-2606-47e6-8d63-c9b4227575cc'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:58:26 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-5c8c1083-a235-4f93-b70e-216bc3eef197 tempest-ProjectMemberTests-1735269541 None] Delete snapshot completed successfully. Sep 16 17:58:26 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-5c8c1083-a235-4f93-b70e-216bc3eef197 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-49f569d1-3067-4454-b872-bc5b920d6f45-delete_snapshot" released by "delete_snapshot" :: held 1.717s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:26 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-71583182-5079-4830-8d4e-823ef3a267c9 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-691b3f89-ab28-42ad-833c-fe66be5b65e7-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:26 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-71583182-5079-4830-8d4e-823ef3a267c9 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-691b3f89-ab28-42ad-833c-fe66be5b65e7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:26 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-71583182-5079-4830-8d4e-823ef3a267c9 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-691b3f89-ab28-42ad-833c-fe66be5b65e7" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:26 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-71583182-5079-4830-8d4e-823ef3a267c9 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-691b3f89-ab28-42ad-833c-fe66be5b65e7" acquired by "delete_volume" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:27 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b5e3d1-1836-49c2-a6e5-85fc035b0004]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-71583182-5079-4830-8d4e-823ef3a267c9 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:27 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7 Sep 16 17:58:27 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:27 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-71583182-5079-4830-8d4e-823ef3a267c9 tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7" returned: 0 in 0.437s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-71583182-5079-4830-8d4e-823ef3a267c9 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:27 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7 Sep 16 17:58:27 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:27 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-71583182-5079-4830-8d4e-823ef3a267c9 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-691b3f89-ab28-42ad-833c-fe66be5b65e7" returned: 0 in 0.261s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:27 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-71583182-5079-4830-8d4e-823ef3a267c9 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-691b3f89-ab28-42ad-833c-fe66be5b65e7" released by "delete_volume" :: held 0.770s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:27 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-71583182-5079-4830-8d4e-823ef3a267c9 tempest-ProjectMemberTests-1735269541 None] Created reservations ['130510af-03fe-43fb-841c-c89741146319', '2c1670a1-16b8-44fb-84df-45e166ce5029', 'fef6fe0e-0a62-4a11-84aa-cbfde651dfef', 'f523d430-c7cc-43ac-8833-453be99a2235'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:58:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-71583182-5079-4830-8d4e-823ef3a267c9 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-71583182-5079-4830-8d4e-823ef3a267c9 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:27 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-71583182-5079-4830-8d4e-823ef3a267c9 tempest-ProjectMemberTests-1735269541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:58:27 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-71583182-5079-4830-8d4e-823ef3a267c9 tempest-ProjectMemberTests-1735269541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:58:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-71583182-5079-4830-8d4e-823ef3a267c9 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:27 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-71583182-5079-4830-8d4e-823ef3a267c9 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:27 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:58:27 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:28 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-71583182-5079-4830-8d4e-823ef3a267c9 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.265s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-71583182-5079-4830-8d4e-823ef3a267c9 tempest-ProjectMemberTests-1735269541 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:58:28 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-71583182-5079-4830-8d4e-823ef3a267c9 tempest-ProjectMemberTests-1735269541 None] Deleted volume successfully. Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-71583182-5079-4830-8d4e-823ef3a267c9 tempest-ProjectMemberTests-1735269541 None] Lock "cinder-691b3f89-ab28-42ad-833c-fe66be5b65e7-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Flow 'volume_create_manager' (58b2a192-4a0f-4ba1-af3f-d3b38575d436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad5a094-f45c-423a-a5e1-9e96cb47e75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad5a094-f45c-423a-a5e1-9e96cb47e75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1205863335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67659a1e-9d07-4621-960a-a8c250e7768d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86c45c52eba4c698ff7edf1ea9c075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:58:29Z,use_quota=True,user_id='ff634f34ed8b49ceaa2f8e9b6bee7419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aad2a6d-bf43-44cc-94cf-19d158d28bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aad2a6d-bf43-44cc-94cf-19d158d28bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a162f332-6dc9-410e-a52b-edea2a92bad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a162f332-6dc9-410e-a52b-edea2a92bad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67659a1e-9d07-4621-960a-a8c250e7768d', 'volume_name': 'volume-67659a1e-9d07-4621-960a-a8c250e7768d', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00666ce9-4e82-493e-8a29-1dee97404028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00666ce9-4e82-493e-8a29-1dee97404028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f921e7-2c62-4464-9e84-e2a6b18e86aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:28 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Volume 67659a1e-9d07-4621-960a-a8c250e7768d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67659a1e-9d07-4621-960a-a8c250e7768d', 'volume_size': 1} Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1205863335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67659a1e-9d07-4621-960a-a8c250e7768d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86c45c52eba4c698ff7edf1ea9c075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:58:29Z,use_quota=True,user_id='ff634f34ed8b49ceaa2f8e9b6bee7419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Creating volume 67659a1e-9d07-4621-960a-a8c250e7768d {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:58:28 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:58:28 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:28 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d 1073741824 Sep 16 17:58:28 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:29 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d 1073741824" returned: 0 in 0.454s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:29 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d Sep 16 17:58:29 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:29 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d" returned: 0 in 0.284s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:29 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:58:29 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f921e7-2c62-4464-9e84-e2a6b18e86aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67659a1e-9d07-4621-960a-a8c250e7768d', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57d99059-7aa6-49d1-83f2-c1aeae67c102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:29 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Volume volume-67659a1e-9d07-4621-960a-a8c250e7768d (67659a1e-9d07-4621-960a-a8c250e7768d): created successfully Sep 16 17:58:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57d99059-7aa6-49d1-83f2-c1aeae67c102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:29 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Flow 'volume_create_manager' (58b2a192-4a0f-4ba1-af3f-d3b38575d436) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:58:29 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-664410a9-3c88-45cc-b620-5bc394521dac tempest-ProjectMemberTests-1735269541 None] Created volume successfully. Sep 16 17:58:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1ea702c1-f4e4-4359-96f6-2edcf7611e02 tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1ea702c1-f4e4-4359-96f6-2edcf7611e02 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:30 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-1ea702c1-f4e4-4359-96f6-2edcf7611e02 tempest-ProjectMemberTests-1735269541 None] Creating offline snapshot af2e4312-7f86-4dca-8ab7-96e9a74c7ccb of volume 67659a1e-9d07-4621-960a-a8c250e7768d {{(pid=85899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 17:58:30 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c1a10b-adf6-473c-8ed3-9bb3e8340481]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:30 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1ea702c1-f4e4-4359-96f6-2edcf7611e02 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:31 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d Sep 16 17:58:31 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:31 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1ea702c1-f4e4-4359-96f6-2edcf7611e02 tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d" returned: 0 in 0.385s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1ea702c1-f4e4-4359-96f6-2edcf7611e02 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.af2e4312-7f86-4dca-8ab7-96e9a74c7ccb 1G {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:31 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.af2e4312-7f86-4dca-8ab7-96e9a74c7ccb 1G Sep 16 17:58:31 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:31 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1ea702c1-f4e4-4359-96f6-2edcf7611e02 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.af2e4312-7f86-4dca-8ab7-96e9a74c7ccb 1G" returned: 0 in 0.464s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:31 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1ea702c1-f4e4-4359-96f6-2edcf7611e02 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67659a1e-9d07-4621-960a-a8c250e7768d -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.af2e4312-7f86-4dca-8ab7-96e9a74c7ccb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:31 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67659a1e-9d07-4621-960a-a8c250e7768d -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.af2e4312-7f86-4dca-8ab7-96e9a74c7ccb Sep 16 17:58:31 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:32 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1ea702c1-f4e4-4359-96f6-2edcf7611e02 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67659a1e-9d07-4621-960a-a8c250e7768d -F qcow2 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.af2e4312-7f86-4dca-8ab7-96e9a74c7ccb" returned: 0 in 0.326s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:32 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-1ea702c1-f4e4-4359-96f6-2edcf7611e02 tempest-ProjectMemberTests-1735269541 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.af2e4312-7f86-4dca-8ab7-96e9a74c7ccb is being set with open permissions: ugo+rw Sep 16 17:58:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1ea702c1-f4e4-4359-96f6-2edcf7611e02 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.af2e4312-7f86-4dca-8ab7-96e9a74c7ccb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:32 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.af2e4312-7f86-4dca-8ab7-96e9a74c7ccb Sep 16 17:58:32 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:32 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1ea702c1-f4e4-4359-96f6-2edcf7611e02 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.af2e4312-7f86-4dca-8ab7-96e9a74c7ccb" returned: 0 in 0.276s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1ea702c1-f4e4-4359-96f6-2edcf7611e02 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:32 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.info Sep 16 17:58:32 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:32 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1ea702c1-f4e4-4359-96f6-2edcf7611e02 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.info" returned: 0 in 0.290s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:32 devstack cinder-volume[85899]: WARNING cinder.volume.drivers.remotefs [None req-1ea702c1-f4e4-4359-96f6-2edcf7611e02 tempest-ProjectMemberTests-1735269541 None] /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.info is being set with open permissions: ugo+rw Sep 16 17:58:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1ea702c1-f4e4-4359-96f6-2edcf7611e02 tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.info {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:32 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.info Sep 16 17:58:32 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:32 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:32 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1ea702c1-f4e4-4359-96f6-2edcf7611e02 tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.info" returned: 0 in 0.265s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:33 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1ea702c1-f4e4-4359-96f6-2edcf7611e02 tempest-ProjectMemberTests-1735269541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.102s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:33 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-1ea702c1-f4e4-4359-96f6-2edcf7611e02 tempest-ProjectMemberTests-1735269541 None] Create snapshot completed successfully Sep 16 17:58:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-83fbeb59-85c5-4b5a-a95f-2c3f0cc78bcd tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-af2e4312-7f86-4dca-8ab7-96e9a74c7ccb-delete_snapshot" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-83fbeb59-85c5-4b5a-a95f-2c3f0cc78bcd tempest-ProjectMemberTests-1735269541 None] Lock "cinder-af2e4312-7f86-4dca-8ab7-96e9a74c7ccb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-83fbeb59-85c5-4b5a-a95f-2c3f0cc78bcd tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-67659a1e-9d07-4621-960a-a8c250e7768d" by "delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-83fbeb59-85c5-4b5a-a95f-2c3f0cc78bcd tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-67659a1e-9d07-4621-960a-a8c250e7768d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-83fbeb59-85c5-4b5a-a95f-2c3f0cc78bcd tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-af2e4312-7f86-4dca-8ab7-96e9a74c7ccb" by "_delete_snapshot" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:34 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-83fbeb59-85c5-4b5a-a95f-2c3f0cc78bcd tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-af2e4312-7f86-4dca-8ab7-96e9a74c7ccb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-83fbeb59-85c5-4b5a-a95f-2c3f0cc78bcd tempest-ProjectMemberTests-1735269541 None] Deleting offline snapshot af2e4312-7f86-4dca-8ab7-96e9a74c7ccb of volume 67659a1e-9d07-4621-960a-a8c250e7768d {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 17:58:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-83fbeb59-85c5-4b5a-a95f-2c3f0cc78bcd tempest-ProjectMemberTests-1735269541 None] snapshot_file for this snap is: volume-67659a1e-9d07-4621-960a-a8c250e7768d.af2e4312-7f86-4dca-8ab7-96e9a74c7ccb {{(pid=85899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 17:58:34 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec40830-6498-44d9-b64c-9c6a87122c68]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-83fbeb59-85c5-4b5a-a95f-2c3f0cc78bcd tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.af2e4312-7f86-4dca-8ab7-96e9a74c7ccb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:34 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.af2e4312-7f86-4dca-8ab7-96e9a74c7ccb Sep 16 17:58:34 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:34 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-83fbeb59-85c5-4b5a-a95f-2c3f0cc78bcd tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.af2e4312-7f86-4dca-8ab7-96e9a74c7ccb" returned: 0 in 0.412s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:34 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-83fbeb59-85c5-4b5a-a95f-2c3f0cc78bcd tempest-ProjectMemberTests-1735269541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67659a1e-9d07-4621-960a-a8c250e7768d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 17:58:34 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fd1103-5364-4cb2-baf3-68c166413a9b]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:34 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-83fbeb59-85c5-4b5a-a95f-2c3f0cc78bcd tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:34 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d Sep 16 17:58:34 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:35 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-83fbeb59-85c5-4b5a-a95f-2c3f0cc78bcd tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d" returned: 0 in 0.413s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-83fbeb59-85c5-4b5a-a95f-2c3f0cc78bcd tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.af2e4312-7f86-4dca-8ab7-96e9a74c7ccb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:35 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.af2e4312-7f86-4dca-8ab7-96e9a74c7ccb Sep 16 17:58:35 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:35 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-83fbeb59-85c5-4b5a-a95f-2c3f0cc78bcd tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.af2e4312-7f86-4dca-8ab7-96e9a74c7ccb" returned: 0 in 0.384s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-83fbeb59-85c5-4b5a-a95f-2c3f0cc78bcd tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.af2e4312-7f86-4dca-8ab7-96e9a74c7ccb {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:35 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.af2e4312-7f86-4dca-8ab7-96e9a74c7ccb Sep 16 17:58:35 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:35 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:35 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-83fbeb59-85c5-4b5a-a95f-2c3f0cc78bcd tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d.af2e4312-7f86-4dca-8ab7-96e9a74c7ccb" returned: 0 in 0.298s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:35 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-83fbeb59-85c5-4b5a-a95f-2c3f0cc78bcd tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-af2e4312-7f86-4dca-8ab7-96e9a74c7ccb" released by "_delete_snapshot" :: held 1.630s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:35 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-83fbeb59-85c5-4b5a-a95f-2c3f0cc78bcd tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-67659a1e-9d07-4621-960a-a8c250e7768d" released by "delete_snapshot" :: held 1.657s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:35 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-83fbeb59-85c5-4b5a-a95f-2c3f0cc78bcd tempest-ProjectMemberTests-1735269541 None] Created reservations ['d49d6151-a777-4532-ba38-c1f4e4635031', '2767538b-5178-4b68-a514-2f41ee43f3d8', 'e0c3c6e7-535a-4a3c-8ee5-18e38e5e2bd6', 'be5344a0-b512-48f7-9eb5-ddb06164272c'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:58:36 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-83fbeb59-85c5-4b5a-a95f-2c3f0cc78bcd tempest-ProjectMemberTests-1735269541 None] Delete snapshot completed successfully. Sep 16 17:58:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-83fbeb59-85c5-4b5a-a95f-2c3f0cc78bcd tempest-ProjectMemberTests-1735269541 None] Lock "cinder-af2e4312-7f86-4dca-8ab7-96e9a74c7ccb-delete_snapshot" released by "delete_snapshot" :: held 1.825s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-abd064d2-38ba-4b56-9b65-5147d21ccedb tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-67659a1e-9d07-4621-960a-a8c250e7768d-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-abd064d2-38ba-4b56-9b65-5147d21ccedb tempest-ProjectMemberTests-1735269541 None] Lock "cinder-67659a1e-9d07-4621-960a-a8c250e7768d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-abd064d2-38ba-4b56-9b65-5147d21ccedb tempest-ProjectMemberTests-1735269541 None] Acquiring lock "cinder-quobyte-67659a1e-9d07-4621-960a-a8c250e7768d" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:36 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-abd064d2-38ba-4b56-9b65-5147d21ccedb tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-67659a1e-9d07-4621-960a-a8c250e7768d" acquired by "delete_volume" :: waited 0.033s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:36 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e07ec9e-fb15-44c1-a817-3ac5f45a6d32]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-abd064d2-38ba-4b56-9b65-5147d21ccedb tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:36 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d Sep 16 17:58:36 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:36 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-abd064d2-38ba-4b56-9b65-5147d21ccedb tempest-ProjectMemberTests-1735269541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d" returned: 0 in 0.401s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:36 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-abd064d2-38ba-4b56-9b65-5147d21ccedb tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:36 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d Sep 16 17:58:36 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:37 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-abd064d2-38ba-4b56-9b65-5147d21ccedb tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-67659a1e-9d07-4621-960a-a8c250e7768d" returned: 0 in 0.283s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-abd064d2-38ba-4b56-9b65-5147d21ccedb tempest-ProjectMemberTests-1735269541 None] Lock "cinder-quobyte-67659a1e-9d07-4621-960a-a8c250e7768d" released by "delete_volume" :: held 0.760s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:37 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-abd064d2-38ba-4b56-9b65-5147d21ccedb tempest-ProjectMemberTests-1735269541 None] Created reservations ['f606d121-f110-48cd-afda-4b438dbe8bca', '3628048a-de88-4d59-9af9-7296bf46a5af', '276a2eeb-7b2d-4929-b00b-4ef50297ade1', 'd09e7c08-4f4f-41d6-b6a0-eecb055ddc23'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:58:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-abd064d2-38ba-4b56-9b65-5147d21ccedb tempest-ProjectMemberTests-1735269541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-abd064d2-38ba-4b56-9b65-5147d21ccedb tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:37 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-abd064d2-38ba-4b56-9b65-5147d21ccedb tempest-ProjectMemberTests-1735269541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:58:37 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-abd064d2-38ba-4b56-9b65-5147d21ccedb tempest-ProjectMemberTests-1735269541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:58:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-abd064d2-38ba-4b56-9b65-5147d21ccedb tempest-ProjectMemberTests-1735269541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-abd064d2-38ba-4b56-9b65-5147d21ccedb tempest-ProjectMemberTests-1735269541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:37 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:58:37 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:37 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:37 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-abd064d2-38ba-4b56-9b65-5147d21ccedb tempest-ProjectMemberTests-1735269541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.306s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:37 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-abd064d2-38ba-4b56-9b65-5147d21ccedb tempest-ProjectMemberTests-1735269541 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:58:37 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-abd064d2-38ba-4b56-9b65-5147d21ccedb tempest-ProjectMemberTests-1735269541 None] Deleted volume successfully. Sep 16 17:58:37 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-abd064d2-38ba-4b56-9b65-5147d21ccedb tempest-ProjectMemberTests-1735269541 None] Lock "cinder-67659a1e-9d07-4621-960a-a8c250e7768d-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:39 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:58:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Flow 'volume_create_manager' (3ff416b9-3018-44a5-ba06-9fb31368d988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:58:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef73984-7d06-462d-b4f8-87d122960bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef73984-7d06-462d-b4f8-87d122960bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1783229429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08be891c-c110-4c37-98eb-37b12fe2bea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31b1f2bc4ba0478180d3f5b828cc39c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:58:40Z,use_quota=True,user_id='b82bb47689724bba8832f40437a98bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ee3843-2d73-4687-a322-ac9e15b50c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ee3843-2d73-4687-a322-ac9e15b50c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be75ab48-d215-4434-9746-e62ffc383c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be75ab48-d215-4434-9746-e62ffc383c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08be891c-c110-4c37-98eb-37b12fe2bea4', 'volume_name': 'volume-08be891c-c110-4c37-98eb-37b12fe2bea4', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffb8c5e8-0c01-49b4-a56d-8000c36c5ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffb8c5e8-0c01-49b4-a56d-8000c36c5ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:39 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed310ec-fa03-4d41-991f-ccf3a0c909a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:39 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Volume 08be891c-c110-4c37-98eb-37b12fe2bea4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08be891c-c110-4c37-98eb-37b12fe2bea4', 'volume_size': 1} Sep 16 17:58:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1783229429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08be891c-c110-4c37-98eb-37b12fe2bea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31b1f2bc4ba0478180d3f5b828cc39c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:58:40Z,use_quota=True,user_id='b82bb47689724bba8832f40437a98bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:58:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Creating volume 08be891c-c110-4c37-98eb-37b12fe2bea4 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:58:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:58:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:58:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:39 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:58:39 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:58:39 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08be891c-c110-4c37-98eb-37b12fe2bea4 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:40 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08be891c-c110-4c37-98eb-37b12fe2bea4 1073741824 Sep 16 17:58:40 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:40 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08be891c-c110-4c37-98eb-37b12fe2bea4 1073741824" returned: 0 in 0.466s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08be891c-c110-4c37-98eb-37b12fe2bea4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:40 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08be891c-c110-4c37-98eb-37b12fe2bea4 Sep 16 17:58:40 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:40 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08be891c-c110-4c37-98eb-37b12fe2bea4" returned: 0 in 0.292s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:40 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:58:40 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed310ec-fa03-4d41-991f-ccf3a0c909a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08be891c-c110-4c37-98eb-37b12fe2bea4', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e64d772-0b51-48c2-83a2-91d3584f391c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:40 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Volume volume-08be891c-c110-4c37-98eb-37b12fe2bea4 (08be891c-c110-4c37-98eb-37b12fe2bea4): created successfully Sep 16 17:58:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e64d772-0b51-48c2-83a2-91d3584f391c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:40 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Flow 'volume_create_manager' (3ff416b9-3018-44a5-ba06-9fb31368d988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:58:40 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-dd50df15-608f-431b-84d9-e57a8b8ea77e tempest-ProjectReaderTests-697575201 None] Created volume successfully. Sep 16 17:58:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9ea25194-e5b6-406d-afab-442e6e4163ab tempest-ProjectReaderTests-697575201 None] Acquiring lock "cinder-08be891c-c110-4c37-98eb-37b12fe2bea4-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9ea25194-e5b6-406d-afab-442e6e4163ab tempest-ProjectReaderTests-697575201 None] Lock "cinder-08be891c-c110-4c37-98eb-37b12fe2bea4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9ea25194-e5b6-406d-afab-442e6e4163ab tempest-ProjectReaderTests-697575201 None] Acquiring lock "cinder-quobyte-08be891c-c110-4c37-98eb-37b12fe2bea4" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9ea25194-e5b6-406d-afab-442e6e4163ab tempest-ProjectReaderTests-697575201 None] Lock "cinder-quobyte-08be891c-c110-4c37-98eb-37b12fe2bea4" acquired by "delete_volume" :: waited 0.016s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:42 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce910e2-3776-4a54-a1a2-63d75b74f757]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9ea25194-e5b6-406d-afab-442e6e4163ab tempest-ProjectReaderTests-697575201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08be891c-c110-4c37-98eb-37b12fe2bea4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:42 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08be891c-c110-4c37-98eb-37b12fe2bea4 Sep 16 17:58:42 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:42 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9ea25194-e5b6-406d-afab-442e6e4163ab tempest-ProjectReaderTests-697575201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08be891c-c110-4c37-98eb-37b12fe2bea4" returned: 0 in 0.383s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9ea25194-e5b6-406d-afab-442e6e4163ab tempest-ProjectReaderTests-697575201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08be891c-c110-4c37-98eb-37b12fe2bea4 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:42 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08be891c-c110-4c37-98eb-37b12fe2bea4 Sep 16 17:58:42 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:42 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9ea25194-e5b6-406d-afab-442e6e4163ab tempest-ProjectReaderTests-697575201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08be891c-c110-4c37-98eb-37b12fe2bea4" returned: 0 in 0.246s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:42 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9ea25194-e5b6-406d-afab-442e6e4163ab tempest-ProjectReaderTests-697575201 None] Lock "cinder-quobyte-08be891c-c110-4c37-98eb-37b12fe2bea4" released by "delete_volume" :: held 0.676s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:42 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-9ea25194-e5b6-406d-afab-442e6e4163ab tempest-ProjectReaderTests-697575201 None] Created reservations ['5064e884-b899-467c-8762-707c3c56e4ca', 'e11883a1-0b76-4979-80a6-2bbe1ed34ca7', 'c151f76d-d8e8-43c7-a383-042f5f5e5da6', '8f00e52c-de7f-4aaa-836f-6a09f214eb5a'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:58:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9ea25194-e5b6-406d-afab-442e6e4163ab tempest-ProjectReaderTests-697575201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:42 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9ea25194-e5b6-406d-afab-442e6e4163ab tempest-ProjectReaderTests-697575201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:42 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9ea25194-e5b6-406d-afab-442e6e4163ab tempest-ProjectReaderTests-697575201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-9ea25194-e5b6-406d-afab-442e6e4163ab tempest-ProjectReaderTests-697575201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-9ea25194-e5b6-406d-afab-442e6e4163ab tempest-ProjectReaderTests-697575201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9ea25194-e5b6-406d-afab-442e6e4163ab tempest-ProjectReaderTests-697575201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:43 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:58:43 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:43 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-9ea25194-e5b6-406d-afab-442e6e4163ab tempest-ProjectReaderTests-697575201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.265s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-9ea25194-e5b6-406d-afab-442e6e4163ab tempest-ProjectReaderTests-697575201 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:58:43 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-9ea25194-e5b6-406d-afab-442e6e4163ab tempest-ProjectReaderTests-697575201 None] Deleted volume successfully. Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-9ea25194-e5b6-406d-afab-442e6e4163ab tempest-ProjectReaderTests-697575201 None] Lock "cinder-08be891c-c110-4c37-98eb-37b12fe2bea4-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Flow 'volume_create_manager' (7ab4acdc-fb45-4b73-90a3-d6aef35c6d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4893a0b-dc8c-4d2e-8d0f-d8a539542245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4893a0b-dc8c-4d2e-8d0f-d8a539542245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1560902639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08943323-800b-49cb-b694-c0974229ca01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31b1f2bc4ba0478180d3f5b828cc39c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:58:44Z,use_quota=True,user_id='b82bb47689724bba8832f40437a98bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b6986a-59eb-486d-ba21-bc788353d283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b6986a-59eb-486d-ba21-bc788353d283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8811b73-fe45-4a38-b905-6472e8d5b7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8811b73-fe45-4a38-b905-6472e8d5b7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08943323-800b-49cb-b694-c0974229ca01', 'volume_name': 'volume-08943323-800b-49cb-b694-c0974229ca01', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3541c277-d7d5-4ef6-8b69-a8c7acecb467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3541c277-d7d5-4ef6-8b69-a8c7acecb467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963252ab-cc0e-40b0-9d9d-133f95aa8cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:43 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Volume 08943323-800b-49cb-b694-c0974229ca01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08943323-800b-49cb-b694-c0974229ca01', 'volume_size': 1} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1560902639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08943323-800b-49cb-b694-c0974229ca01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31b1f2bc4ba0478180d3f5b828cc39c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:58:44Z,use_quota=True,user_id='b82bb47689724bba8832f40437a98bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Creating volume 08943323-800b-49cb-b694-c0974229ca01 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:58:43 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:58:43 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08943323-800b-49cb-b694-c0974229ca01 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:43 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08943323-800b-49cb-b694-c0974229ca01 1073741824 Sep 16 17:58:43 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:44 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08943323-800b-49cb-b694-c0974229ca01 1073741824" returned: 0 in 0.427s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08943323-800b-49cb-b694-c0974229ca01 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:44 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08943323-800b-49cb-b694-c0974229ca01 Sep 16 17:58:44 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:44 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08943323-800b-49cb-b694-c0974229ca01" returned: 0 in 0.267s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:44 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:58:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963252ab-cc0e-40b0-9d9d-133f95aa8cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08943323-800b-49cb-b694-c0974229ca01', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17551cf4-dce7-4cd6-8ca8-ce98e22f0edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:44 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Volume volume-08943323-800b-49cb-b694-c0974229ca01 (08943323-800b-49cb-b694-c0974229ca01): created successfully Sep 16 17:58:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17551cf4-dce7-4cd6-8ca8-ce98e22f0edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:44 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Flow 'volume_create_manager' (7ab4acdc-fb45-4b73-90a3-d6aef35c6d43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:58:44 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-295079d5-dedf-4c0c-8cd9-b4100323e289 tempest-ProjectReaderTests-697575201 None] Created volume successfully. Sep 16 17:58:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7503e434-593c-46a0-8ffe-f10ea66a6769 tempest-ProjectReaderTests-697575201 None] Acquiring lock "cinder-08943323-800b-49cb-b694-c0974229ca01-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7503e434-593c-46a0-8ffe-f10ea66a6769 tempest-ProjectReaderTests-697575201 None] Lock "cinder-08943323-800b-49cb-b694-c0974229ca01-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7503e434-593c-46a0-8ffe-f10ea66a6769 tempest-ProjectReaderTests-697575201 None] Acquiring lock "cinder-quobyte-08943323-800b-49cb-b694-c0974229ca01" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:44 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7503e434-593c-46a0-8ffe-f10ea66a6769 tempest-ProjectReaderTests-697575201 None] Lock "cinder-quobyte-08943323-800b-49cb-b694-c0974229ca01" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:44 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[273fdfe0-c101-4750-b907-0aec23472b72]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:44 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7503e434-593c-46a0-8ffe-f10ea66a6769 tempest-ProjectReaderTests-697575201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08943323-800b-49cb-b694-c0974229ca01 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:45 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08943323-800b-49cb-b694-c0974229ca01 Sep 16 17:58:45 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:45 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7503e434-593c-46a0-8ffe-f10ea66a6769 tempest-ProjectReaderTests-697575201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08943323-800b-49cb-b694-c0974229ca01" returned: 0 in 0.385s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7503e434-593c-46a0-8ffe-f10ea66a6769 tempest-ProjectReaderTests-697575201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08943323-800b-49cb-b694-c0974229ca01 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:45 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08943323-800b-49cb-b694-c0974229ca01 Sep 16 17:58:45 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:45 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7503e434-593c-46a0-8ffe-f10ea66a6769 tempest-ProjectReaderTests-697575201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-08943323-800b-49cb-b694-c0974229ca01" returned: 0 in 0.266s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:45 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7503e434-593c-46a0-8ffe-f10ea66a6769 tempest-ProjectReaderTests-697575201 None] Lock "cinder-quobyte-08943323-800b-49cb-b694-c0974229ca01" released by "delete_volume" :: held 0.697s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:45 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-7503e434-593c-46a0-8ffe-f10ea66a6769 tempest-ProjectReaderTests-697575201 None] Created reservations ['4d9e4462-aaca-44c0-a83c-8d8b51292213', '7806f9ca-c207-48d3-a99d-ae4ec794c132', '365d615b-c57e-4072-9f4c-499aba651b69', '3f6cffa8-4e5c-4a40-a65d-4a9494e5ce3f'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:58:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7503e434-593c-46a0-8ffe-f10ea66a6769 tempest-ProjectReaderTests-697575201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7503e434-593c-46a0-8ffe-f10ea66a6769 tempest-ProjectReaderTests-697575201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7503e434-593c-46a0-8ffe-f10ea66a6769 tempest-ProjectReaderTests-697575201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:58:45 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-7503e434-593c-46a0-8ffe-f10ea66a6769 tempest-ProjectReaderTests-697575201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:58:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-7503e434-593c-46a0-8ffe-f10ea66a6769 tempest-ProjectReaderTests-697575201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:45 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7503e434-593c-46a0-8ffe-f10ea66a6769 tempest-ProjectReaderTests-697575201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:45 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:58:45 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:46 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-7503e434-593c-46a0-8ffe-f10ea66a6769 tempest-ProjectReaderTests-697575201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.256s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-7503e434-593c-46a0-8ffe-f10ea66a6769 tempest-ProjectReaderTests-697575201 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:58:46 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-7503e434-593c-46a0-8ffe-f10ea66a6769 tempest-ProjectReaderTests-697575201 None] Deleted volume successfully. Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-7503e434-593c-46a0-8ffe-f10ea66a6769 tempest-ProjectReaderTests-697575201 None] Lock "cinder-08943323-800b-49cb-b694-c0974229ca01-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Flow 'volume_create_manager' (5f527b07-9e2d-47fa-8a59-2222c7b30d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfbd1904-48e9-43e2-a4ef-12d82c9ddbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfbd1904-48e9-43e2-a4ef-12d82c9ddbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-351695112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f9c59f-0164-4635-85c2-f6a782650e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31b1f2bc4ba0478180d3f5b828cc39c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:58:47Z,use_quota=True,user_id='b82bb47689724bba8832f40437a98bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9d4243-3541-4cce-aef3-9aea12a16a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9d4243-3541-4cce-aef3-9aea12a16a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c9b3c7b-c89f-434d-acfd-742631e20a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c9b3c7b-c89f-434d-acfd-742631e20a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f9c59f-0164-4635-85c2-f6a782650e02', 'volume_name': 'volume-36f9c59f-0164-4635-85c2-f6a782650e02', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e487fb-1165-4903-9d2b-dbf8efa95ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e487fb-1165-4903-9d2b-dbf8efa95ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec63808-f2e9-43ad-9a59-059891983899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:46 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Volume 36f9c59f-0164-4635-85c2-f6a782650e02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f9c59f-0164-4635-85c2-f6a782650e02', 'volume_size': 1} Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-351695112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f9c59f-0164-4635-85c2-f6a782650e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31b1f2bc4ba0478180d3f5b828cc39c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:58:47Z,use_quota=True,user_id='b82bb47689724bba8832f40437a98bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Creating volume 36f9c59f-0164-4635-85c2-f6a782650e02 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:58:46 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:58:46 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-36f9c59f-0164-4635-85c2-f6a782650e02 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:46 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-36f9c59f-0164-4635-85c2-f6a782650e02 1073741824 Sep 16 17:58:46 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:47 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-36f9c59f-0164-4635-85c2-f6a782650e02 1073741824" returned: 0 in 0.449s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-36f9c59f-0164-4635-85c2-f6a782650e02 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:47 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-36f9c59f-0164-4635-85c2-f6a782650e02 Sep 16 17:58:47 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:47 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-36f9c59f-0164-4635-85c2-f6a782650e02" returned: 0 in 0.259s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:47 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:58:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec63808-f2e9-43ad-9a59-059891983899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f9c59f-0164-4635-85c2-f6a782650e02', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8aa61d8-55e2-4d30-998c-7a19b7b204db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:47 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Volume volume-36f9c59f-0164-4635-85c2-f6a782650e02 (36f9c59f-0164-4635-85c2-f6a782650e02): created successfully Sep 16 17:58:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8aa61d8-55e2-4d30-998c-7a19b7b204db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:47 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Flow 'volume_create_manager' (5f527b07-9e2d-47fa-8a59-2222c7b30d2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:58:47 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-1037d3f0-cbe1-430d-a203-322a0f24ac09 tempest-ProjectReaderTests-697575201 None] Created volume successfully. Sep 16 17:58:47 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-446f61d5-1280-461a-a066-63b98356429a tempest-ProjectReaderTests-697575201 None] Acquiring lock "cinder-36f9c59f-0164-4635-85c2-f6a782650e02-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:47 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-446f61d5-1280-461a-a066-63b98356429a tempest-ProjectReaderTests-697575201 None] Lock "cinder-36f9c59f-0164-4635-85c2-f6a782650e02-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:47 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-446f61d5-1280-461a-a066-63b98356429a tempest-ProjectReaderTests-697575201 None] Acquiring lock "cinder-quobyte-36f9c59f-0164-4635-85c2-f6a782650e02" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:47 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-446f61d5-1280-461a-a066-63b98356429a tempest-ProjectReaderTests-697575201 None] Lock "cinder-quobyte-36f9c59f-0164-4635-85c2-f6a782650e02" acquired by "delete_volume" :: waited 0.018s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:47 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[09be39b6-58ea-453a-b4db-d0ef28f164cc]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:47 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-446f61d5-1280-461a-a066-63b98356429a tempest-ProjectReaderTests-697575201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-36f9c59f-0164-4635-85c2-f6a782650e02 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:47 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-36f9c59f-0164-4635-85c2-f6a782650e02 Sep 16 17:58:47 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:48 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-446f61d5-1280-461a-a066-63b98356429a tempest-ProjectReaderTests-697575201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-36f9c59f-0164-4635-85c2-f6a782650e02" returned: 0 in 0.408s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-446f61d5-1280-461a-a066-63b98356429a tempest-ProjectReaderTests-697575201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-36f9c59f-0164-4635-85c2-f6a782650e02 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:48 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-36f9c59f-0164-4635-85c2-f6a782650e02 Sep 16 17:58:48 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:48 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-446f61d5-1280-461a-a066-63b98356429a tempest-ProjectReaderTests-697575201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-36f9c59f-0164-4635-85c2-f6a782650e02" returned: 0 in 0.306s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-446f61d5-1280-461a-a066-63b98356429a tempest-ProjectReaderTests-697575201 None] Lock "cinder-quobyte-36f9c59f-0164-4635-85c2-f6a782650e02" released by "delete_volume" :: held 0.763s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:48 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-446f61d5-1280-461a-a066-63b98356429a tempest-ProjectReaderTests-697575201 None] Created reservations ['1cd8eb0c-71c1-4e8f-baf1-ad103910a865', '687c613a-c94d-4fcb-b9c9-04107998b4a0', 'f3f97fbc-d644-4cf6-ad21-fb80a4648f2d', 'ded42892-e51b-4f14-9061-d1805bc33f1c'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:58:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-446f61d5-1280-461a-a066-63b98356429a tempest-ProjectReaderTests-697575201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-446f61d5-1280-461a-a066-63b98356429a tempest-ProjectReaderTests-697575201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-446f61d5-1280-461a-a066-63b98356429a tempest-ProjectReaderTests-697575201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:58:48 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-446f61d5-1280-461a-a066-63b98356429a tempest-ProjectReaderTests-697575201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:58:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-446f61d5-1280-461a-a066-63b98356429a tempest-ProjectReaderTests-697575201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-446f61d5-1280-461a-a066-63b98356429a tempest-ProjectReaderTests-697575201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:48 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:58:48 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:48 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:48 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-446f61d5-1280-461a-a066-63b98356429a tempest-ProjectReaderTests-697575201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.281s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:48 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-446f61d5-1280-461a-a066-63b98356429a tempest-ProjectReaderTests-697575201 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:58:48 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-446f61d5-1280-461a-a066-63b98356429a tempest-ProjectReaderTests-697575201 None] Deleted volume successfully. Sep 16 17:58:48 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-446f61d5-1280-461a-a066-63b98356429a tempest-ProjectReaderTests-697575201 None] Lock "cinder-36f9c59f-0164-4635-85c2-f6a782650e02-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG cinder.volume.flows.manager.create_volume [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Flow 'volume_create_manager' (da1ac361-1e3e-40fe-ba43-5ab0fe5c2b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0a2b8f-c6ca-4502-be50-e09bfaea5f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0a2b8f-c6ca-4502-be50-e09bfaea5f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1350732825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d9a93b-a744-42ee-9bc5-0106451481d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31b1f2bc4ba0478180d3f5b828cc39c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:58:49Z,use_quota=True,user_id='b82bb47689724bba8832f40437a98bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce372d4-9b04-4803-a137-c08b030ce592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce372d4-9b04-4803-a137-c08b030ce592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78eba4d-6573-47e3-8a9f-b54d323b13b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78eba4d-6573-47e3-8a9f-b54d323b13b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65d9a93b-a744-42ee-9bc5-0106451481d2', 'volume_name': 'volume-65d9a93b-a744-42ee-9bc5-0106451481d2', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e78b530-9413-4ac8-83ae-6e84ae23a886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e78b530-9413-4ac8-83ae-6e84ae23a886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a826bea-7797-421e-ba3a-e22e838319ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:49 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Volume 65d9a93b-a744-42ee-9bc5-0106451481d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65d9a93b-a744-42ee-9bc5-0106451481d2', 'volume_size': 1} Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T15:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1350732825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d9a93b-a744-42ee-9bc5-0106451481d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31b1f2bc4ba0478180d3f5b828cc39c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T15:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T15:58:49Z,use_quota=True,user_id='b82bb47689724bba8832f40437a98bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6829c338-000e-4597-92d5-6b6750127b79),volume_type_id=6829c338-000e-4597-92d5-6b6750127b79)}" {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.remotefs [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Creating volume 65d9a93b-a744-42ee-9bc5-0106451481d2 {{(pid=85899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Selected osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 as target Quobyte volume. {{(pid=85899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 17:58:49 devstack cinder-volume[85899]: INFO cinder.volume.drivers.remotefs [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] casted to osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7 Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-65d9a93b-a744-42ee-9bc5-0106451481d2 1073741824 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:49 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-65d9a93b-a744-42ee-9bc5-0106451481d2 1073741824 Sep 16 17:58:49 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:49 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-65d9a93b-a744-42ee-9bc5-0106451481d2 1073741824" returned: 0 in 0.487s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:49 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-65d9a93b-a744-42ee-9bc5-0106451481d2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:49 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-65d9a93b-a744-42ee-9bc5-0106451481d2 Sep 16 17:58:49 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:50 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-65d9a93b-a744-42ee-9bc5-0106451481d2" returned: 0 in 0.261s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:50 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'} {{(pid=85899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 17:58:50 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a826bea-7797-421e-ba3a-e22e838319ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65d9a93b-a744-42ee-9bc5-0106451481d2', 'volume_size': 1}' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d92f84-fcd4-4b78-b301-549db88a8cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 17:58:50 devstack cinder-volume[85899]: INFO cinder.volume.flows.manager.create_volume [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Volume volume-65d9a93b-a744-42ee-9bc5-0106451481d2 (65d9a93b-a744-42ee-9bc5-0106451481d2): created successfully Sep 16 17:58:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d92f84-fcd4-4b78-b301-549db88a8cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 17:58:50 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Flow 'volume_create_manager' (da1ac361-1e3e-40fe-ba43-5ab0fe5c2b56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 17:58:50 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-faf919f7-47b2-49c4-921f-05d4bf4007d2 tempest-ProjectReaderTests-697575201 None] Created volume successfully. Sep 16 17:58:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6fb94652-4ddd-439f-ab1a-767710e04ab5 tempest-ProjectReaderTests-697575201 None] Acquiring lock "cinder-65d9a93b-a744-42ee-9bc5-0106451481d2-delete_volume" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6fb94652-4ddd-439f-ab1a-767710e04ab5 tempest-ProjectReaderTests-697575201 None] Lock "cinder-65d9a93b-a744-42ee-9bc5-0106451481d2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6fb94652-4ddd-439f-ab1a-767710e04ab5 tempest-ProjectReaderTests-697575201 None] Acquiring lock "cinder-quobyte-65d9a93b-a744-42ee-9bc5-0106451481d2" by "delete_volume" {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 17:58:51 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6fb94652-4ddd-439f-ab1a-767710e04ab5 tempest-ProjectReaderTests-697575201 None] Lock "cinder-quobyte-65d9a93b-a744-42ee-9bc5-0106451481d2" acquired by "delete_volume" :: waited 0.017s {{(pid=85899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 17:58:51 devstack cinder-volume[85899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc1f29f-2d91-48cc-a7fe-628c9c921e39]: (4, 'qcow2') {{(pid=87034) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 17:58:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6fb94652-4ddd-439f-ab1a-767710e04ab5 tempest-ProjectReaderTests-697575201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-65d9a93b-a744-42ee-9bc5-0106451481d2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:51 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-65d9a93b-a744-42ee-9bc5-0106451481d2 Sep 16 17:58:51 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:51 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6fb94652-4ddd-439f-ab1a-767710e04ab5 tempest-ProjectReaderTests-697575201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-65d9a93b-a744-42ee-9bc5-0106451481d2" returned: 0 in 0.386s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:51 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6fb94652-4ddd-439f-ab1a-767710e04ab5 tempest-ProjectReaderTests-697575201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-65d9a93b-a744-42ee-9bc5-0106451481d2 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:51 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-65d9a93b-a744-42ee-9bc5-0106451481d2 Sep 16 17:58:51 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:52 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6fb94652-4ddd-439f-ab1a-767710e04ab5 tempest-ProjectReaderTests-697575201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777/volume-65d9a93b-a744-42ee-9bc5-0106451481d2" returned: 0 in 0.271s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:52 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6fb94652-4ddd-439f-ab1a-767710e04ab5 tempest-ProjectReaderTests-697575201 None] Lock "cinder-quobyte-65d9a93b-a744-42ee-9bc5-0106451481d2" released by "delete_volume" :: held 0.700s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:58:52 devstack cinder-volume[85899]: DEBUG cinder.quota [None req-6fb94652-4ddd-439f-ab1a-767710e04ab5 tempest-ProjectReaderTests-697575201 None] Created reservations ['c011ab01-22ee-4a11-8ef3-9c3b5ead8369', '85f84d26-3283-43cc-8c4c-131b6b9e4433', '5b97b5d3-c73e-486d-80ff-f2827d6262d2', '9bc27abe-fa83-4de3-ab35-0b1d8ea22fdd'] {{(pid=85899) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 17:58:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6fb94652-4ddd-439f-ab1a-767710e04ab5 tempest-ProjectReaderTests-697575201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:58:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6fb94652-4ddd-439f-ab1a-767710e04ab5 tempest-ProjectReaderTests-697575201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:58:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6fb94652-4ddd-439f-ab1a-767710e04ab5 tempest-ProjectReaderTests-697575201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:58:52 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-6fb94652-4ddd-439f-ab1a-767710e04ab5 tempest-ProjectReaderTests-697575201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:58:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-6fb94652-4ddd-439f-ab1a-767710e04ab5 tempest-ProjectReaderTests-697575201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:58:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6fb94652-4ddd-439f-ab1a-767710e04ab5 tempest-ProjectReaderTests-697575201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:58:52 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:58:52 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:58:52 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Sep 16 17:58:52 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-6fb94652-4ddd-439f-ab1a-767710e04ab5 tempest-ProjectReaderTests-697575201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.278s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:58:52 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-6fb94652-4ddd-439f-ab1a-767710e04ab5 tempest-ProjectReaderTests-697575201 None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:58:52 devstack cinder-volume[85899]: INFO cinder.volume.manager [None req-6fb94652-4ddd-439f-ab1a-767710e04ab5 tempest-ProjectReaderTests-697575201 None] Deleted volume successfully. Sep 16 17:58:52 devstack cinder-volume[85899]: DEBUG cinder.coordination [None req-6fb94652-4ddd-439f-ab1a-767710e04ab5 tempest-ProjectReaderTests-697575201 None] Lock "cinder-65d9a93b-a744-42ee-9bc5-0106451481d2-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=85899) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 17:59:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:59:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 17:59:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 17:59:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7': None} {{(pid=85899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 17:59:02 devstack cinder-volume[85899]: DEBUG cinder.volume.drivers.quobyte [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e7975-68c7-40f3-932d-aa0ce4a046a7'] {{(pid=85899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 17:59:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.lockutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 17:59:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 17:59:02 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777 Sep 16 17:59:02 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 17:59:02 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:SELECT=91,cinder:INSERT=26,cinder:UPDATE=118,cinder:DELETE=8 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 17:59:02 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Sep 16 17:59:02 devstack cinder-volume[85899]: DEBUG oslo_concurrency.processutils [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c3761fefc7cb64a0fcf2bcd72dd22777" returned: 0 in 0.258s {{(pid=85899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 17:59:02 devstack cinder-volume[85899]: DEBUG cinder.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Notifying Schedulers of capabilities ... {{(pid=85899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 17:59:02 devstack cinder-volume[85899]: DEBUG oslo_service.periodic_task [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] Running periodic task VolumeManager._thread_info {{(pid=85899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 17:59:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread count: 29 {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5468}} Sep 16 17:59:02 devstack cinder-volume[85899]: DEBUG cinder.volume.manager [None req-b93a69d5-cdba-48e4-8bf4-c74f425e1226 None None] thread info: [<_MainThread(MainThread, started 123748124422272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5469}} Sep 16 17:59:02 devstack cinder-volume[85899]: DEBUG dbcounter [-] [85899] Writing DB stats cinder:DELETE=12,cinder:SELECT=76,cinder:INSERT=36,cinder:UPDATE=120 {{(pid=85899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}